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Abstract 

An  Evaluation  of  the  Connecticut  General  Assistance 
Managed  Behavioral  Health  Care  Pilot  Program 

Neil  M.  Thakur 
1998 

This  dissertation  will  evaluate  the  Connecticut  Department  of  Mental  Health  and 
Addiction  Services  (DMHAS)  General  Assistance  Pilot  (GAP)  program  that  provided 
managed  mental  health  and  substance  abuse  services  to  General  Assistance  (GA)  clients. 
The  GAP  was  designed  to  increase  access  to  care  and  lower  costs  by  collocating 
clinicians  at  welfare  offices,  creating  provider  networks,  and  managing  utilization. 

The  evaluation  focuses  on  the  three  largest  and  oldest  GAP  sites:  Bridgeport; 
Hartford;  and  New  Haven.  Key  informant  interviews  and  archival  analysis  are  used  to 
qualitatively  explore  organizational  impacts  of  the  collocation  strategy.  Quantitative 
analysis  of  electronic  GA  and  DMHAS  records  from  1992-1996  explore  the  case  finding 
and  utilization  management  processes. 

This  dissertation  explores  two  policy  issues.  The  first  concerns  integrating  the 
delivery  of  social  services  across  agencies  with  different  training,  expertise,  funding,  and 
missions.  Results  indicate  that  collocation  first  led  to  tension  between  clinical  and 
welfare  staff,  but  later  resulted  in  productive  collaboration.  GA  Recipients  from  Hartford 
and  New  Haven  were  more  likely  to  access  DMHAS  care  after  implementation  of  the 
GAP  if  their  GA  benefits  were  active.  The  GAP  access  process  was  most  efficient  in 
sites  with  the  most  intense  collocation. 


The  second  policy  issue  is  that  of  state  agencies  directly  managing  their  own 
services.  Qualitative  data  analysis  suggests  publicly  operated  managed  care  programs 
may  have  weaker  oversight  and  manage  network  providers  less  aggressively  than  other 
public  managed  care  models. 

Though  costs  of  DMHAS  services  for  GA  clients  dropped  after  implementation  of 
the  GAP,  DMHAS  costs  also  fell  for  these  same  clients  while  their  care  was  not  managed 
by  the  GAP.  The  main  reason  for  costs  declines  may  be  a  reduction  in  the  number  of 
DMHAS  mental  health  inpatient  beds,  and  the  implementation  of  a  prior  authorization 
program  for  all  inpatient  admissions  prior  to  implementation  of  the  GAP. 

Though  some  these  of  findings  are  mixed,  the  GAP  does  suggest  a  viable  model 
for  publicly  operated  managed  care.  Ways  to  correct  some  of  the  GAP's  shortcomings 
will  also  be  considered. 
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Chapter  1:  Introduction 

This  dissertation  will  evaluate  the  Connecticut  Department  of  Mental  Health  and 
Addiction  Services  (DMHAS1)  General  Assistance  Pilot  (GAP)  program  that  provides 
managed  mental  health  and  substance  abuse  services  to  General  Assistance  (GA)  clients. 
The  analyses  will  focus  on  the  effectiveness  of  the  GAP's  managed  care  services  and  the 
strategies  used  to  implement  them.  Study  of  the  GAP  also  allows  discussion  of 
difficulties  in  the  organization  and  financing  of  public  sector  health  services.  Because  the 
GAP  is  implemented  differently  in  several  sites,  this  dissertation  will  describe  the  variety 
of  ways  in  which  managed  care  practices  can  be  incorporated  into  public  programs  and 
how  they  affect  social  service  organizations  and  behavioral  health  care  utilization. 

1.  Introduction  to  the  public  sector  behavioral  health  system 

The  public  sector  behavioral  health  system  is  complex  and  fragmented.  The 
Federal  government  loosely  directs  behavioral  health  services  to  the  indigent  through  the 
Medicaid  and  Medicare  programs  and  through  the  provision  of  block  grants  to  States  for 
persons  with  severe  illnesses  and  no  insurance.  States  use  these  funds  in  different  ways. 

In  Connecticut,  there  are  three  typical  sources  of  payment  for  behavioral  health 
care  to  the  indigent:  General  Assistance,  Medicaid  are  health  insurances  for  the  poor,  and 
cover  most  behavioral  health  services.  Medicaid  is  funded  by  the  State  and  Federal 
government,  to  insure  poor  people  with  disabilities  and  poor  families  with  children,  and 
is  partially  overseen  by  the  Federal  Health  Care  Finance  Agency  (HCFA). 
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General  Assistance  (GA)  is  very  similar  to  Medicaid  in  that  it  provides  medical 
insurance  to  the  indigent,  but  can  also  include  cash  assistance.  GA  is  designed  to  fill 
some  of  the  holes  in  Medicaid  eligibility,  offering  assistance  to  indigent  people  who  do 
not  have  other  insurance  coverage,  such  as  single  people  without  children,  or  those 
temporarily  disabled.  GA  recipients  deemed  employable  have  job  seeking  requirements, 
though  recipients  assigned  to  the  unemployable  category2  do  not.  As  of  July  1993,  GA 
recipients  with  substance  abuse  problems  also  have  substance  abuse  treatment 
compliance  requirements.  GA  caseworkers  can  suspend  cash  benefits  to  any  recipient 
who  does  not  comply  with  their  treatment  plan  or  violates  other  administrative  rules. 

The  GA  program  is  monitored  by  the  Department  of  Social  Services  (DSS)  on  the 
state  level,  and  administered  by  each  town3.  The  Connecticut  State  government  pays  for 
80%  of  medical  bills,  and  each  town  or  city  that  the  recipient  lives  in  pays  20%. 

Both  Medicaid  and  GA  bill  providers  for  medical  services  at  the  same  rate 
through  the  same  information  management  system,  with  three  exceptions.  First,  since 
GA  is  entirely  controlled  by  the  states  and  towns,  and  has  little  federal  oversight,  it  may 
cover  some  services  that  Medicaid  does  not  cover.  Second,  because  the  Medicaid  rate  is 
set  artificially  low,  the  federal  government  awards  an  annual  disproportionate  share 
payment  to  inpatient  facilities  to  correct  for  any  gross  underpayment.  GA  does  not. 
Third,  both  systems  can  have  their  clients  treated  by  either  private  providers.or  a  network 


1  On  July  1,  1995,  the  Connecticut  Department  of  Mental  Health  (DMH)  became  the  Department  of 
Mental  Health  Addiction  Services  (DMHAS).  For  simplicity,  both  DMH  and  the  mental  health  components 
of  DMHAS  will  be  referred  to  as  DMHAS  in  this  dissertation. 

2  Recipients  assigned  to  the  unemployable  category  meet  one  of  the  following  criteria:  not  in  school;  under 
16;  over  65;  or  over  55  with  a  history  of  chronic  unemployment;  have  a  child  under  two;  caring  for  an 
incapacitated  spouse  or  child;  or  waiting  for  federal  benefits  such  as  Medicare  or  Medicaid. 

3  This  administrative  arrangement  remained  in  effect  throughout  the  study  period  (1992-1996).  As  of  1997, 
DSS  directly  administers  GA  benefits  in  most  towns. 
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of  behavioral  health  facilities  directly  operated  DMHAS.  These  state  operated  facilities 
bill  Medicaid  for  services,  but  do  not  bill  GA. 

The  DMHAS  system  is  a  distinct  set  of  treatment  services  and  payment  sources 
focusing  on  Connecticut  residents  with  serious  mental  illness  or  substance  abuse 
problems — many  of  whom  are  indigent  and  have  no  medical  insurance.  DMHAS 
directly  operates  several  inpatient  substance  abuse  and  mental  health  hospitals,  as  well  as 
Local  Mental  Health  Authorities  (LMHAs)  that  serve  as  outpatient  mental  health  clinics 
(some  have  inpatient  beds  and  substance  abuse  treatment  services  as  well).  All  facilities 
can  bill  to  third  party  payers  such  as  Medicaid  and  Medicare,  though  their  revenue  goes 
into  the  state  General  Fund,  and  DMHAS  must  compete  with  other  state  agencies  to  have 
it  allocated  back  to  them  in  the  next  budget.  DMHAS  also  receives  block  grants  for 
mental  health  and  substance  abuse  services  from  various  federal  agencies. 

Most  of  the  substance  abuse  providers,  some  of  the  LMHAs,  and  some  of  the 
other  mental  health  services  are  privately  run.  They  are  expected  to  treat  indigent  clients 
for  free  in  exchange  for  DMHAS  block  grants.  The  LMHAs  running  the  GAP  programs 
this  dissertation  will  be  focusing  on  are  all  state  owned  and  operated. 

2.  Impetus  for  reform 

The  entitlement-like  structure  of  the  GA  medical  program  has  made  it  very 
expensive,  and  behavioral  health  expenditures  have  been  a  major  portion  of  these  costs. 
In  FY93,  18%  of  all  statewide  GA  health  expenditures  were  spent  on  behavioral  health 
care  (Thomas,  1995).  Legislators  became  alarmed  at  the  rising  costs  and  the  lack  of 
control  on  the  health  benefit.  Prior  to  implementation  of  the  pilot,  GA  clients  in  any  of 
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the  towns  could  receive  any  type  of  service  covered  by  Connecticut  Medicaid  from  any 
provider,  and  it  would  be  paid  for  by  General  Assistance  at  Medicaid  fee-for-service 
rates.  City  welfare  'Case  managers'  (whom  I  refer  to  as  'Caseworkers'  in  this  dissertation 
to  distinguish  them  from  DMHAS  case  managers  with  formal  clinical  training)  were 
thought  unable  to  adequately  supervise  client  utilization. 

Though  Connecticut  politicians  and  program  administrators  had  been  reluctant  to 
minimize  access  to  health  care  for  GA  clients,  service  costs  continued  to  increase. 
However,  they  also  felt  that  mental  health  and  substance  abuse  services  could  sometimes 
be  substituted  with  other  less  intensive  forms  of  care  without  appreciable  difference  in 
outcomes.  Therefore,  the  Legislature  authorized  DSS  and  DMHAS  to  collaborate  to  let 
LMHAs  manage  the  behavioral  health  services  of  GA  clients  in  seven  Connecticut  cities. 
These  cities  have  all  implemented  the  program  in  slightly  different  ways.  They  are 
consistent,  however,  in  their  attempt  to  lower  costs  and  triage  clients  with  mental  illness 
and/or  substance  abuse  problems  into  appropriate  care. 

3.  Program  description 

DMHAS  and  DSS  established  the  GAP  program  in  July  1993  through  a  item  in 
the  State  budget.  The  GAP  gave  DMHAS  clinical  and  fiscal  responsibility  for  the 
behavioral  health  treatment  of  GA  recipients.  The  management  process  includes  case 
identification,  treatment  planning  and  coordination,  and  various  forms  of  utilization 
management  or  prior  authorization  review.  The  primary  goals  of  the  program  are  to:  1) 
reduce  behavioral  health  expenditures;  and,  2)  ensure  or  increase  access  to  behavioral 
health  care. 
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As  a  secondary  goal,  DMHAS  would  also  try  to  shift  GA  costs  to  federal 
entitlement  programs  by  enhancing  the  application  process  to  Social  Security  and 
Medicaid.  Operationally,  this  was  not  a  priority  at  most  sites,  and  received  little  attention 
form  GAP  staff.  DMHAS  claimed  to  obtain  federal  entitlements  for  only  82  people  out 
of  15,000  to  20,000  active  GA  recipients  in  the  first  year  of  GAP  funding.  Because  this 
is  such  a  rare  event,  efforts  to  obtain  Federal  entitlements  will  not  be  evaluated  in  this 
dissertation. 

DMHAS  attempted  to  meet  the  goals  of  cost  reduction  and  access  coordination 
through  three  managed  care  and  organizational  mechanisms.  Their  primary  strategy  to 
increase  access  was  to  collocate  (station)  DMHAS  clinicians  at  welfare  offices  to 
clinically  screen  GA  recipients  for  behavioral  health  needs.  Clients  would  either  self 
refer  to  these  clinicians,  or  be  referred  to  them  by  GA  caseworkers. 

Second,  GAPs  established  a  network  of  providers  that  included  the  GAP  staffs 
parent  LMHA  and  private  providers.  Most  of  the  private  providers  had  been  treating  GA 
recipients  prior  to  the  GAP,  but  this  population  was  largely  new  to  DMHAS  facilities. 

The  third  managed  care  mechanism  was  utilization  management,  which  typically 
consisted  of  prior  authorization  for  inpatient  and  respite  services.  Much  of  the  public 
sector's  managed  behavioral  health  care  experience  has  been  through  Medicaid  managed 
care  programs,  but  unlike  these  programs,  GAP  utilization  management  was  conducted 
directly  by  state  employees. 
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4.  Policy  Issues 


This  dissertation  will  evaluate  these  three  strategies  are  explored  in  the  three 
largest  and  oldest  GAP  sites,  Bridgeport,  Hartford,  and  New  Haven,  through  qualitative 
and  quantitative  methods.  Key  informant  interviews  and  archival  analysis  are  used  to 
qualitatively  explore  organizational  impacts  of  the  collocation  strategy.  Quantitative 
analysis  of  electronic  GA  and  DMHAS  records  offer  insight  into  the  case  finding  and 
utilization  management  processes. 

In  addition  to  evaluating  the  GAP  for  its  own  sake,  this  dissertation  explores  two 
policy  issues.  The  first  concerns  integrating  the  delivery  of  social  services  across 
agencies  with  different  training,  expertise,  funding,  and  missions.  The  GAP  challenged 
traditional  thinking  and  roles  for  both  DMHAS  and  its  partner  city  welfare  agencies. 
DMHAS  has  traditionally  focused  on  mental  illness  or  substance  abuse  that  leads  to 
disability.  Most  GA  recipients  are  less  impaired,  and  thus  presents  new  clinical 
challenges  to  DMHAS  staff.  City  welfare  staffs'  primary  responsibility  is  to  fairly 
distribute  benefits,  and  the  technical  and  logistic  difficulties  in  coordinating  more  closely 
with  clinical  staff  requires  additional  work,  training  and  resources. 

The  GAP  exemplifies  how  these  social  services  can  be  integrated  by  stationing 
DMHAS  staff  in  welfare  offices.  This  collocation  first  led  to  tension  between  the  two 
sets  of  line  staff,  but  also  appeared  to  result  in  productive  collaboration.  GA  Recipients 
from  Hartford  and  New  Haven  were  much  more  likely  to  access  DMHAS  care  after 
implementation  of  the  GAP  if  their  GA  benefits  were  active. 
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The  success  of  the  collaboration  also  appears  to  vary  by  collocation  intensity.  GA 
recipient  referrals  from  GA  staff  to  DMHAS  staff  for  behavioral  health  services  was  most 
accurate  in  sites  that  had  the  most  DMHAS  staff  and  resources  collocated  at  GA  offices, 
and  least  accurate  when  collocation  was  the  least  intense. 

The  second  policy  issue  is  that  of  state  agencies  directly  managing  their  own 
services.  Currently,  most  states  run  managed  care  programs  through  private  contractors 
with  different  for-profit  statuses  and  risk  sharing  arrangements.  The  GAP  presents  a 
viable  alternative  to  all  of  these  more  traditional  models  that  other  states  could 
consider — GAP  behavioral  health  care  was  managed  directly  by  state  employees,  through 
a  prospective  global  budget. 

Oversight  of  publicly  operated  managed  care  programs  may  be  weaker  than  other 
forms  of  publicly  funded  managed  care.  For  example,  the  federal  oversight  of  Medicaid 
is  a  major  force  in  public  sector  managed  care.  The  Health  Care  Finance  Administration 
(HCFA)  carefully  reviews  any  state  proposal  to  manage  Medicaid  services,  and  mandates 
a  fairly  rigorous  evaluation.  GA  is  under  no  such  constraints,  and  the  GAP  provides  an 
example  of  what  a  state  can  do  with  minimal  Federal  oversight  and  regulation.  In  this 
case,  oversight  of  GAP  activities  was  conducted  primarily  by  the  State  legislature,  and 
DMHAS' s  internal  monitoring  of  GAP  activity  was  far  less  rigorous  than  more 
traditional  oversight  of  a  managed  care  contractor. 

Public  sector  managed  care  agencies  may  be  less  demanding  on  private  network 
providers.  GAP  staff  informants  expressed  sympathy  for  the  financial  and  clinical 
difficulties  faced  by  some  their  providers,  and  concern  for  the  availability  of  services  in 
general. 
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Though  costs  of  DMHAS  services  for  GA  clients  dropped  after  implementation  of 
the  GAP,  DMHAS  costs  also  fell  for  these  same  clients  while  their  care  was  not  managed 
by  the  GAP.  The  main  reason  for  cost  declines  appear  to  be  a  reduction  in  the  number  of 
DMHAS  mental  health  inpatient  beds,  and  the  implementation  of  a  prior  authorization 
program  of  all  inpatient  admissions  prior  to  implementation  of  the  GAP. 

These  issues  will  be  further  developed  in  the  following  six  chapters.  Chapter  2 
reviews  the  literature  surrounding  systems  integration  and  managed  care  and  generates  an 
evaluation  framework  for  public  sector  managed  care  programs.  Chapter  3  will  describe 
each  GAP  evaluation  site  in  detail,  and  define  measurable  hypotheses  for  the  portions  of 
the  evaluation  framework  that  available  data  will  allow.  Chapter  4  will  present  a  quasi- 
experimental  methodology  to  explore  this  framework  that  relies  on  administrative  data 
linkage  and  key  informant  interviews.  Chapter  5  will  discuss  the  organizational  impacts 
of  public  sector  behavioral  health  care  and  income  assistance  systems  integration. 
Leadership,  collocation,  and  joint  training  will  be  shown  to  be  important  in  implementing 
this  complicated  interagency  model.  Chapter  6  will  describe  the  impact  of  the  GAP  on 
GA  recipients.  Strong  evidence  that  access  to  DMHAS  services  increased  will  be 
presented.  Costs  of  DMHAS  care  will  be  shown  to  have  declined,  but  thescsavings 
cannot  be  clearly  attributed  to  the  GAP.  The  final  chapter  will  describe  the  relationships 
between  organizational  level  integration  strategies  and  individuals'  experience  of 
managed  behavioral  health  care,  and  conclude  with  a  discussion  on  how  government 
agencies  may  more  effectively  directly  manage  care. 
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Chapter  2:   Review  of  the  Literature 


The  General  Assistance  Pilot  Program  (GAP)  provides  managed  behavioral  health 
services  through  Local  Mental  Health  Authorities  (LMHAs)  to  people  enrolled  in 
General  Assistance  (GA).  After  a  brief  introduction  to  the  public  sector  behavioral  health 
care  system,  this  chapter  will  address  the  theoretical  implications  of  the  GAP  design  and 
evaluation  in  terms  of  the  policy  issues  addressed  in  this  dissertation.  The  evidence 
supporting  techniques  to  integrate  service  delivery  systems  to  increase  their  flexibility, 
accountability,  and  efficiency  will  be  discussed.  Evidence  on  public  sector  behavioral 
health  managed  care  will  also  be  presented,  and  expectations  for  such  programs  will  be 
described  in  terms  of  an  evaluation  framework  that  guides  much  of  the  analysis  of  this 
dissertation. 

The  service  integration  and  managed  care  literatures  are  different,  and  suggest 
different  research  questions  and  techniques,  even  though  they  apply  to  the  same  program. 
The  service  integration  literature  is  focused  on  the  organizational  level,  and  the  issues 
that  it  raises  are  explored  through  analysis  of  archives  and  key  informant  interviews  of 
LMHA  and  Welfare  staff.  The  managed  care  literature  better  lends  itself  to  quantitative 
measures,  and  client  level  analyses  are  conducted  on  administrative  databases.  These  sets 
of  literature  and  their  analyses  are  presented  separately  until  the  Discussion  chapter, 
where  the  overlapping  elements  of  each  set  are  integrated.  A  review  of  their  supporting 
literature  follows. 
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1.  Behavioral  Health  System  Overview 

Income  assistance  is  just  one  service  that  many  GA  recipients  need.  In  terms  of 
behavioral  health,  GA  clients  can  be  grouped  into  five  populations:  1)  people  who  are 
indigent  but  have  no  behavioral  health  needs;  2)  people  who  are  indigent  and  have 
behavioral  health  service  needs,  but  who  lack  significant  disability  or  impairment;  3) 
indigent  people  with  serious  mental  illness;  4)  indigent  people  with  substance  abuse  or 
dependence  disorders;  and  5)  people  who  are  impaired  by  some  combination  of  substance 
abuse  and  mental  health  disorders.  The  second  group  has  received  little  direct  attention 
from  health  services  in  the  past  decade.  The  latter  three  groups  have  considerable  clinical 
needs,  and  have  had  services,  funding,  government  agencies,  and  professional  disciplines 
built  up  around  them.  The  GAP  is  responsible  for  mental  health  services  for  all  five 
client  groups,  and  for  identifying  those  in  need  of  care,  lowering  the  costs  of  care,  and 
helping  clients  to  enroll  onto  federal  entitlements  or  become  job  ready. 

A.  Client  need 

In  the  United  States,  state  governments  are  charged  with  caring  for  indigent 
people  with  severe  mental  illness  and/or  with  substance  abuse  problems.  Both  groups 
suffer  from  various  levels  of  disability,  and  social,  physical,  and  financial  difficulties. 

The  actual  prevalence  of  mental  health  and  substance  abuse  disorders  among 
Connecticut  GA  recipients  is  unknown.  Johnson  and  Shepard  (1995)  found  that  almost 
30%  of  former  Pennsylvania  GA  recipients  classified  as  'employable'  had  a  lifetime 
history  of  alcohol  or  drug  treatment,  and  about  10%  had  a  history  of  mental  health 
treatment.  In  one  study  of  inpatients  with  schizophrenia,  income  assistance  has  been 
associated  with  increased  use  of  cocaine  and  behavioral  health  treatment  (Shaner, 
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Eckman,  Roberts,  Wilkins,  Tucker,  Tsuang  &  Mintz,  1995),  but  this  association  was  not 
found  in  a  community  based  sample  of  homeless  clients  with  mental  illness  (Frisman  & 
Rosenheck,  1997). 

Despite  the  lack  of  evidence  about  the  behavioral  health  needs  of  GA  clients, 
these  problems  are  assumed  to  be  common  enough  to  change  policy.  The  largely 
untested  notion  that  income  assistance  subsidizing  substance  abuse  is  a  popular  reason  to 
limit  welfare  benefits  (Rosenheck,  1997).  Substance  abuse,  as  well  as  other  behavioral 
health  problems,  are  thought  to  be  so  common  among  Connecticut  GA  recipients  (in 
1994,  Connecticut  Judge  Spada  claimed  it  rampant),  that  they  are  assumed  to  contribute 
to  the  long  tenure  of  some  clients  on  Connecticut  GA  benefits. 

Though  the  exact  prevalence  of  impairment  may  not  be  clear,  the  needs  of  GA 
recipients  with  these  problems  are  better  understood.  GA  recipients  may  suffer  from 
educational  deficits.  For  example,  45-50%  of  most  states'  GA  populations  do  not  have  a 
high  school  diploma,  and  in  1992,  the  Summit  County,  Ohio  GA  program  reported  68% 
of  its  recipients  could  not  understand  all  of  the  instructions  on  a  job  application  (Halter, 
1996).  Severe  behavioral  health  disability  is  frequently  coupled  with  poverty,  leading  to 
difficulty  in  finding  food,  shelter  and  other  resources  (Feitel,  Margetson,  Chamas,  & 
Lipman,  1992;  Rosenheck  &  Lam,  1997a;  Rossi,  1990;  Spinner  &  Leaf,  1992;  Susser, 
Moore,  &  Link,  1993).  Disability  and  stigma  contribute  to  social  isolation,  family  burden 
and  joblessness  (Clark  &  Drake,  1994;  Gubman,  Tessler,  &  Willis,  1987;  Horwitz, 
Tessler,  Fisher,  &  Gamache,  1992;  Tessler  &  Gamache,  1994;  Tessler,  Gamache,  & 
Fisher,  1991).  Further,  serious  mental  illness  and  substance  abuse  often  co-occur 
(Regier,  Farmer,  Rae,  Locke,  Keith,  Judd  &  Goodwin,  1990),  but  the  clinical  methods 
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and  social  attitudes  surrounding  serious  mental  illness  and  substance  abuse  are  different, 
and  these  dually  diagnosed  clients  do  not  always  merge  smoothly  into  one  system  or 
another. 

B.  Difficulty  in  integrating  substance  abuse  and  mental  health  care  models 

With  the  merger  of  the  Connecticut  mental  health  and  substance  abuse  authorities 

and  public  hospitals  in  1995,  the  substance  abuse  treatment  and  the  serious  mental  illness 
treatment  models  have  converged,  but  the  basic  clinical  approaches  for  the  two  are 
fundamentally  different  on  two  key  features  -  responsibility  and  recovery.  These 
differences  affect  the  type  of  care  their  clients  receive  and  the  structure  of  the  GAP. 

Mental  health  providers  assume  more  responsibility  for  their  clients  than 
substance  abuse  providers.  Under  the  Community  Support  Program  (CSP)  (Turner  & 
TenHoor,  1978),  persons  with  serious  mental  illness  are  considered  to  be  permanently 
disabled  and  need  lifelong  care.  Bachrach  (1992),  in  her  discussion  of  mental  health 
treatment  paradigms,  was  more  explicit:  "the  vulnerabilities  of  people  with  long  term 
mental  illnesses  are  not  time  limited  ...  they  are  often  lifelong  and  so  require  continuing 
intervention".  Further,  people  with  serious  mental  illness  are  thought  to  rapidly  lose  their 
community  living  skills  unless  they  remain  in  the  community.  The  potential  loss  in 
functioning  brought  on  by  inpatient  hospitalization  encourages  use  of  community  based 
alternatives  to  inpatient  care  when  possible. 

In  contrast,  substance  abuse  providers  expect  people  to  recover  -  some  models 
even  demand  clients  abstain  from  drugs.  These  differences  in  expectations  between 
substance  abuse  and  mental  health  result  in  two  major  effects  (Drake,  McLaughlin, 
Pepper,  &  Minkoff,  1991;  Minkoff,  1989;  Swindle,  Phibbs,  Paradise,  Recine,  &  Moos, 
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1995).  First,  strict  control  of  a  client's  environment  can  guarantee  a  period  of  abstinence 
and  facilitate  recovery,  giving  inpatient  substance  abuse  treatment  an  advantage  over 
other  modalities  without  the  corresponding  decline  in  community  functioning  expected 
from  inpatient  mental  health  care.  Second,  some  substance  abuse  treatment  philosophies 
also  dictate  that  clients  must  be  highly  motivated  or  even  reach  a  crisis  phase  before 
treatment  will  become  fully  effective.  Thus,  substance  abuse  providers  are  typically  less 
assertive  than  their  mental  health  counterparts  and  will  often  not  help  a  client  until  the 
client  explicitly  asks  (Minkoff,  1991).  In  contrast,  mental  health  case  managers  view 
their  responsibility  to  include  helping  the  client  deal  with  any  mistake  the  client  may 
make  in  following  his  or  her  treatment  plan. 

The  discipline  of  substance  abuse  care  is  also  less  academically  oriented  than 
mental  health  care.  As  Chiauzzi  and  Liljegren  (1993)  point  out,  substance  abuse 
treatment  places  a  greater  emphasis  on  paraprofessional  treatment  as  a  therapeutic  tool. 
Further,  the  predominant  Minnesota  and  12  Steps  models  place  a  great  emphasis  on 
spirituality  and  their  clients'  "'higher  power".  Mental  health,  on  the  other  hand,  relies 
more  heavily  on  medications  and  credentialed  professionals. 

These  differences  in  treatment  cultures  can  lead  to  professional 
misunderstandings,  miscommunications,  and  poor  coordination  of  services.  These  two 
groups  of  providers  and  their  systems  most  often  conflict  in  two  circumstances. 

The  first  is  when  a  client  concurrently  has  both  a  serious  mental  illness  and  a 
substance  abuse  disorder.  These  dually  diagnosed  clients  represent  a  sizable  portion  of 
clients  with  serious  mental  illness  -  for  example,  half  or  more  of  clients  in  intensive 
psychiatric  care  settings  have  some  sort  of  substance  abuse  or  dependence  (Galanter, 
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Castaneda,  &  Ferman,  1988).  Dually  diagnosed  clients  are  more  likely  than  people  with 
only  a  serious  mental  illness  to  demonstrate  disruptive,  suicidal,  and  criminal  behaviors; 
to  be  homeless;  and  are  less  likely  to  comply  with  treatment,  or  even  be  in  treatment  at  all 
(Drake,  McLaughlin,  Pepper  &  Minkoff,  1991).  Clients  with  dual  diagnoses  need 
intensive  services  from  both  disciplines. 

The  second  potential  conflict  is  when  a  provider  from  one  group  is  given  the 
responsibility  for  dealing  with  clients  from  another.  Most  of  the  academic  thinking  about 
integrating  services  for  clients  with  both  mental  health  treatment  and  substance  abuse 
treatment  needs  has  been  through  Drake's  'Dual  Diagnosis'  model,  and  it  has  been  helpful 
for  its  intended  target  population.  The  Drake  model  is  specifically  designed  for  clients 
with  serious  and  disabling  mental  illnesses,  such  as  schizophrenia  or  bipolar  disorders.  It 
exports  the  traditional  serious  mental  illness  treatment  model  stressing  community  based 
treatment  and  client  support  to  substance  abuse  problems,  and  places  clinical 
responsibility  clearly  on  mental  health  clinicians.  Several  Connecticut  LMHAs  have 
implemented  Drake  style  dual  diagnosis  intensive  case  management  programs  (Teague, 
Drake,  &  Ackerson,  1995)  similar  to  the  assertive  community  treatment  case 
management  model  (Stein  &  Test,  1980). 

However,  there  are  other  clients  with  lesser  degrees  of  mental  health  or  substance 
abuse  treatment  needs  (Lehman,  Meyers,  Dixon,  &  Johnson,  1994).  The  Drake  model  is 
very  intensive,  and  therefore  not  appropriate  for  people  without  a  disabling  mental 
illness4.  This  model  offers  no  clear  guidance  on  which  profession  should  provide 


4  Though  even  for  this  population,  the  Drake  model  has  been  criticized  for  being  too  intrusive  and  fostering 
dependence  on  care  providers  (Thompson,  Griffith,  &  Leaf,  1990). 
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services  to  clients  who  do  not  have  a  serious  mental  illness  but  have  both  mental  health 
and  substance  abuse  treatment  needs. 

Typically,  such  clients  may  "fall  through  the  cracks"  by  receiving  inappropriate 
treatment  or  no  treatment  at  all.  Program  planners  feel  that  with  a  single  point  of 
accountability  for  client's  well  being,  some  of  the  problems  reported  with  dual  diagnosis 
clients  can  be  avoided  (Drake,  McLaughlin,  Pepper  &  Minkoff,  1991;  Ridgely,  Goldman, 
&  Willenbring,  1990).  Though  the  GAP  does  offer  one  point  of  accountability,  the  utility 
of  asking  mental  health  providers  to  triage  and  care  for  substance  abuse  clients  remains  to 
be  determined. 

2.  Administrative  shortcomings  in  social  service  delivery 

These  clinical  and  professional  issues  serve  as  a  backdrop  for  a  complex 
bureaucratic  system  that  dictates  the  structure  of  service  delivery.  Categorical  funding 
has  created  target  populations  for  individual  social  service  agencies.  The  rigidity  of  these 
organizations  may  hinder  their  attempts  to  create  interagency  programs,  like  the  GAP, 
for  a  broader  population.  Below  are  some  key  sources  of  potential  confusion. 

A.  Federal  level  income  assistance 

A  key  aspect  of  US  social  service  delivery  is  its  categorical  funding  -  a  system 

through  which  funds  are  targeted  to  people  with  certain  characteristics.  These  funds  pass 
from  a  higher  level  of  government  to  a  lower  level  with  restrictions  and  oversight 
requirements  that  vary  by  program. 

The  federal  government  has  several  programs  designed  to  monitor  and  help 
develop  treatment  systems  for  people  with  behavioral  health  needs.  Funding  for  these 
services  is  provided  to  states  through  block  grants  for  the  treatment  of  the  severely 
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disabled/and  or  uninsured,  and  health  insurance  programs  such  as  Medicare  and 
Medicaid.  Supplemental  Security  Income  (SSI)  provides  income  assistance  directly  from 
the  federal  government  to  the  aged,  blind  and  disabled.  SSI  recipients  are  also 
automatically  eligible  for  Medicaid.  Until  1997,  if  clients  disabled  with  substance  abuse 
disorders  undergo  treatment  for  their  addiction,  they  can  receive  SSI  (US  House  of 
Representatives,  1994,  p.  21 l)5.  Disability  Insurance  (SSDI)  is  available  only  to  people 
who  have  paid  payroll  taxes  into  the  Social  Security  system,  and  consists  of  a  cash 
supplement  higher  than  the  one  offered  by  SSI,  and  after  two  years,  eligibility  for 
Medicare  benefits.  Most  GA  clients  do  not  have  long  enough  work  histories  to  qualify 
for  SSDI. 

The  application  process  for  SSI  and  SSDI  are  involved  and  identical,  except  that 
SSI  has  stringent  income  and  asset  limits.  These  elaborate  application  and  screening 
measures  for  federal  entitlements  serve  to  discourage  people  from  applying. 

The  Connecticut  General  Assistance  program  supports  potential  SSI  or  SSDI 
eligible  clients  who  have  not  yet  applied  or  are  waiting  for  federal  aid.  Since  these 
Federal  programs  can  wholly  supplant  services  offered  by  GA,  an  explicit  goal  of  the 
GAP  is  to  help  clients  obtain  entitlements.  Some  GAPs  did  hire  "entitlements 
specialists"  near  the  end  of  this  study's  follow-up  period  to  help  with  the  application 
process.  Applications  are  resolved  within  three  months  at  the  maximum,  though  appeals 
of  denials  may  take  up  to  18  months  for  disposition. 


Substance  addiction  was  removed  as  an  eligibility  category  after  the  end  of  the  follow-up  period  of  this 
study. 
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B.  State  and  local  level 

Traditionally,  Connecticut  residents  who  were  indigent  or  had  substance  abuse 

problems  received  behavioral  health  services  from  a  decentralized  group  of  private 
providers.  These  providers  are  paid  on  a  fee-for-service  basis  through  programs  like 
Medicaid  and  General  Assistance.  These  providers  usually  have  little  contact  with  each 
other,  and  GA  clients  were  expected  to  negotiate  this  system  of  care  with  little  assistance. 

In  contrast,  the  public  sector  mental  health  provider  system  is  relatively 
centralized  around  local  mental  health  authorities,  and  for  the  past  1 0  to  15  years,  has 
been  narrowly  focused  around  people  with  serious  mental  illness.  Several  factors  have 
changed  the  earlier  Community  Mental  Health  Center  model,  which  was  more  oriented  to 
serving  all  people  with  behavioral  health  needs,  to  the  current  model  with  its  more 
focused  target  population  (Mechanic  &  Surles,  1992;  Morrissey  &  Goldman,  1984).  The 
first  involved  the  paradigm  shift  associated  with  the  Community  Support  Program  (CSP) 
model,  which  focused  on  providing  community  based  treatment  to  persons  with  serious 
mental  illness.  Second  are  the  Federal  mental  health  block  grants  established  in  the  early 
1980s,  which  gave  money  to  states  explicitly  to  cover  these  populations6.  Third, 
deinstitutionalization  created  a  pressing  demand  for  community  based  services  by  a  very 
disabled  population  (Grob,  1994).  Finally,  private  health  insurers  (and  eventually 
Medicare  and  Medicaid)  began  to  offer  coverage  for  acute  psychiatric  services,  relieving 


6  However,  block  grants  comprise  only  a  portion  of  state  expenditures  on  serious  mental  illness,  so  at  best, 
block  grants  serve  as  'seed  money'  to  develop  state  services  according  to  some  federal  model.  In  fact, 
Hadley  (1996)  claims  the  incentives  to  shift  to  community  based  care  came  from  State  fiscal  pressure  and 
not  from  Federal  funds  at  all.  More  detailed  studies  (Jacobsen  &  McGuire,  1996)  suggest  that  states 
became  more  responsive  to  mental  health  and  substance  abuse  block  grants  after  1990,  when  the  Federal 
government  made  greater  efforts  to  ensure  state  compliance  with  block  grant  stipulations.  Currently, 
Jacobsen  and  McGuire  claim  that  roughly  every  dollar  of  substance  abuse  block  grants  results  in  another 
dollar  of  state  substance  abuse  spending — the  effect  for  mental  health  services  is  less  pronounced. 
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some  of  the  pressure  on  CMHCs  (now  LMHAs)  to  provide  services  to  non-disabled 
clients. 

The  differences  between  provider  disciplines,  target  populations,  and 
categorically  funded  service  providers  described  above  are  systemic  and  ingrained.  The 
GA  Pilot  program,  with  its  interagency,  multidisciplinary  approach  and  broad  target 
population,  attempts  to  minimize  these  problems.  However,  in  doing  so,  it  exposes 
LMHAs  to  a  more  clinically  varied  and  less  disabled  population  than  they  had  previously 
served. 

3.  The  GAP  and  Systems  Integration 

The  advantage  the  public  sector  mental  health  system  offers  that  other  behavioral 
health  systems  do  not,  are  coordinating  mechanisms  such  as  case  management  (Doolittle 
&  Riccio,  1992;  Sledge,  Astrachan,  Thompson,  Rakfeldt,  &  Leaf,  1995;  Solomon,  1992) 
and  local  mental  health  authorities  (Shore  &  Cohen,  1990).  Though  these  two 
mechanisms  appear  adequate  to  coordinate  services  within  clinical  systems,  problems 
arise  in  coordinating  services  across  systems,  such  as  coordinating  mental  health  services 
with  physical  health  treatment  or  substance  abuse  treatment,  and  even  more  so  with  non- 
clinical services,  such  as  cash,  employment,  or  housing  assistance.  Professional  and 
organizational  differences  between  these  various  systems,  reified  in  part  by  different 
funding  sources,  makes  it  difficult  for  clients  to  receive  all  of  their  needed  services  in  a 
timely  and  efficient  manner. 

Reports  of  difficulties  in  coordinating  services  are  mostly  anecdotal,  but  are  a 
widely  recognized  barrier  to  recovery  and  stability  for  clients  with  serious  mental  illness 
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(e.g.  Outcasts  on  Main  Street,  1992;  Morrissey,  Calloway,  Johnsen  &  Ullman,  1997) , 
and  most  practitioners  feel  that  poor  organization  of  services  can  limit  or  decrease  the 
quality  of  clinical  care.  The  most  glaring  example  of  how  service  fragmentation  can  lead 
to  poor  care  and  poor  client  outcomes  occurs  among  homeless  persons  with  serious 
mental  illness.  For  example,  Rosenheck  and  Lam  (1997b)  found  barriers  to  service  use 
by  homeless  people  with  serious  mental  illness  to  include  aspects  of  service 
fragmentation  such  as  subjects  experiencing  confusion,  hassle,  or  prohibitive  delays  when 
seeking  services.  Further,  differences  in  the  communities  from  which  they  sampled 
explained  more  variance  in  difficulty  in  obtaining  services  than  did  client  characteristics. 
Under  the  prevailing  notion  of  service  fragmentation,  behavioral  health  planners,  and 
especially  mental  health  planners,  have  abandoned  the  idea  that  clients  alone  can 
successfully  coordinate  their  own  services  across  providers. 

A.  Can  integration  improve  services? 

Grusky  and  Tierney  (1989)  define  coordination  as  "the  process  whereby  two  or 

more  organizations  execute  and/or  use  existing  decision  rules  that  have  been  established 
to  deal  collectively  with  their  shared  task  environment".  Behavioral  health  planners  have 
invested  heavily  in  the  idea  that  coordinating  services  across  agencies  can  integrate 
services  on  the  client  level  while  preserving  diversity  in  funding  streams,  agencies  and 
disciplines. 

1)  Theoretical  bases  for  public  sector  service  coordination 

Planners  have  emphasized  coordination  through  changes  in  organizational  and 

clinical  practice.  They  have  taken  the  original  CMHC  model  (Dowell  &  Ciarlo,  1989; 

Hadley,  Culhane,  Mazade,  &  Manderscheid,  1994),  added  the  administrative  and  service 
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structures  of  the  Community  Support  Program,  and  then  tried  to  refine  this  model  with 
the  stronger  service  integration  mechanism  of  LMHAs.  On  the  client  level,  LMHAs  rely 
heavily  on  case  management.  The  GAP  adopts  an  even  stronger  client  level  coordination 
model  using  case  management,  collocation,  and  joint  training,  and  there  are  several 
claims  to  support  this  design. 

Case  management  is  proven  effective  in  helping  clients  obtain  services  from 
multiple  providers  (e.g.  Taube,  Morlock,  Burns  &  Burns,  1990;  Sledge,  Astrachan, 
Thompson,  Rakfeldt  &  Leaf,  1995;  Bachrach,  1992;  Intagliata,  1982).  Beatrice  (1990) 
claims  that  interagency  coordination  can  better  serve  clients  by  offering  a  wider  range 
and  more  integrated  mix  of  services.  Weiss  (1981)  notes  that  this  integrated  program 
design  appeals  to  three  constituencies,  perhaps  in  ways  that  conflict:  service  coordination 
can  make  it  easier  for  clients  to  access  services;  it  gives  clinicians  greater  flexibility;  and 
it  can  promise  administrators  and  politicians  savings  through  service  consolidation  and 
efficiency.  Links  between  service  systems,  such  as  mental  health  care  and  housing 
(Randolph,  Blasinsky,  Leginski,  Parker,  &  Goldman,  1997),  or,  in  the  case  of  the  GAP, 
between  behavioral  health  care  and  income  assistance,  are  referred  to  as  systems 
integration.  Hoge  and  Howenstine  (1997)  feel  that  in  addition  to  major  system  reforms 
like  LMHAs,  smaller  scale  integration  mechanisms  such  as  interagency  task  groups, 
multi-agency  programming,  resource  sharing,  and  cross  training,  are  useful  in  achieving 
Beatrice's  and  Weiss'  goals. 

2)  Theoretical  design  considerations 

For  these  reasons,  the  interagency  design  of  the  GAP  should  be  viewed  as  a 

systems  integration  model  where  GA  case  workers  serve  as  the  linkage  between  the 
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behavioral  health  system  and  the  income  assistance  system  for  client  intake  and  service 
coordination.  The  GAP  model  is  based  on  three  organizational  choices:  1)  to  use 
multiple  agencies  to  handle  intake  and  service  coordination  for  clients;  2)  to  use 
collocation  to  increase  access  to  behavioral  health  services;  and  3),  to  use  joint  training  to 
improve  interagency  and  interdisciplinary  relations.  This  design  is  justified  by  theories 
about  agencies,  leadership,  and  structures  of  interagency  collaborations,  in  relation  to 
client  need. 

Hageback  (1980)  argues  that  the  professional  model  of  mental  health 
organizations  is  ideally  suited  to  lead  cross  discipline  collaborations  because  their  staffs' 
training  in  therapy  is  about  "helping  people  move  from  one  idea  to  another".  Therefore, 
he  claims  these  organizations  are  internally  more  flexible,  and  skilled  in  overcoming 
other  agencies'  attitudinal  barriers.  The  GAP  was  created  by  a  mandate  and  funding 
from  the  Connecticut  Legislature  to  the  State  Mental  Health  Authority  (SMHA),  and  the 
state  welfare  authority  mandated  the  local  welfare  departments  to  comply.  The  SMHA's 
primary  organizational  strategy  was  to  collocate  LMHA  staff  at  GA  offices.  On  the  local 
level,  LMHAs  served  as  initiators  of  the  GAP  planning  process  and  controlled  GAP 
expenditures. 

Judging  from  research  literature,  collocation  may  increase  GA  client  access  to 
care,  but  may  also  bring  to  the  forefront  potential  conflict  across  agencies  and  disciplines. 
Collocation  may  increase  access  to  care  by  the  obvious  mechanism  of  decreasing  clients' 
wait  and  travel  time  to  screening.  It  may  also  increase  access  through  'normalizing' 
behavioral  health  services  in  the  eyes  of  welfare  clients.  Treatment  providers' 
stigmatization  of  clients  has  been  well  explored  (Brown,  1989;  Chung,  Mahler,  & 
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and  has  150  years  of  experience  in  administering  prepaid  services.  Second,  and  perhaps 
most  importantly,  modernizing  for  managed  care  has  its  own  costs,  including  high  start 
up  fees  to  develop  sophisticated  information  systems,  or  a  lengthy  and  complicated 
contracting  process  to  hire  a  vendor  to  run  the  GAP.  The  GAPs  budget  may  have  been 
just  too  small  to  justify  any  major  transformation  of  the  service  system  for  a  limited, 
though  unspecified,  duration. 

Despite  the  unusual  aspects  of  GAP's  financial  arrangements,  it  does  have  many 
of  the  same  goals  as  other  public  sector  managed  care  programs.  Its  incentive  structure 
differs  from  classic  capitation  in  three  ways  (Schlesinger,  1989).  First,  under  capitation, 
providers  maximize  their  income  by  enrolling  as  many  clients  as  possible  and  then 
minimizing  treatment  cost,  whereas  in  the  GAP,  providers  paid  by  grants  can  maximize 
their  profits  by  trying  to  enroll  as  few  clients  as  possible.  Second,  under  capitation,  the 
incentive  to  under-treat  is  kept  in  check  because  if  providers  force  clients  to  drop  out  of 
treatment,  then  the  providers  lose  the  client's  capitation  fee.  In  contrast,  the  GAP  sites  do 
not  lose  money  within  a  budget  year  if  a  client  decides  to  drop  out  of  care.  Finally, 
drawing  from  the  ASO  literature,  the  most  important  incentive  for  government  agencies 
like  DMHAS  (and  perhaps  a  reason  why  they  chose  the  GAP  model)  may  be  their 
reputations,  as  their  entire  budget  process  is  political  and  not  directly  related  to  any 
savings  they  may  achieve.  Successfully  managing  GA  behavioral  health  services  would 
enhance  DMHAS 's  reputation,  aid  DMHAS  is  its  budget  negotiations,  and  also  in  its 
rivalry  with  the  state  Medicaid  authority  for  control  over  a  potential  Medicaid  managed 
behavioral  health  care  carveout. 
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2)  Utilization  Management 

The  GAP's  other  major  managed  care  strategy  is  utilization  management,  which  is 

the  process  of  subjecting  individual  referrals  and  treatment  episodes  to  some  standard  or 
administrative  protocol  before  approving  payment.  When  compared  to  traditional  fee- 
for-service  medicine,  it  is  usually  effective  in  lowering  costs  (e.g.  Bailit  and  Sennet, 
1991;  Dangerfield  and  Betit,  1993).  Due  to  flexibility  and  non-specificity  of  public 
sector  behavioral  treatment  modalities,  utilization  management  often  defines  standards  of 
care  in  a  given  system  (Hoge,  Davidson,  Griffith,  Sledge  &  Howenstine,  1994).  Since 
these  emergent  standards  are  unique  to  each  service  system,  it  is  difficult  for  payers  to  set 
accurate  baseline  expectations  or  judge  quality  (Davidson,  Schlesinger,  Dowart,  & 
Schnell,  1991). 

Lack  of  standards  appear  especially  prevalent  for  substance  abuse  services  when 
compared  to  mental  health  services.  Strumwasser  and  colleagues  (1991),  using  case 
based  physician  reviews  of  admissions,  found  the  rate  of  inappropriate  substance  abuse 
hospitalization  about  twice  as  high  as  the  inappropriate  mental  health  hospitalization  rate 
(75%  substance  abuse  v.  38%  for  mental  health). 

Some  form  of  utilization  management  is  now  standard  in  both  public  and  private 
settings  (Bailit  &  Sennett,  1991).  Mechanic  and  associates  (1995)  provide  a  good  rule  of 
thumb  for  predicting  outcomes  of  a  utilization  management  program:  "...  groups  with 
relatively  higher  costs  can  be  brought  into  line  with  prevailing  practices.  But  there  is  no 
evidence  that  utilization  review  can  change  average  treatment  practices."  The  GAP  is 
remarkable  in  that  there  were  no  prior  utilization  standards,  which  suggest  two  things: 
First,  there  are  no  concrete  criteria  to  judge  the  appropriateness  of  baseline  utilization  in 


44 


terms  of  quality,  except  in  relation  to  utilization  under  the  GAP;  and  second,  utilization 
management  may  have  the  opportunity  to  shape  care  standards  for  GA  clients. 

3)  Combined  managed  care  mechanisms 

Most  managed  care  mechanisms  can  be  implemented  individually  or  combined  in 

a  variety  of  complementary  ways.  Many  payers  offer  a  combination  of  utilization 
management  and  other  financial  incentives  to  control  costs  and  limit  utilization. 

The  impact  of  co-occurring  interventions  are  difficult  to  understand  through 
naturalistic  evaluations.  For  example,  the  Massachusetts  Medicaid  managed  care 
program  found  overall  cost  declines  of  over  20%.  Though  much  of  these  savings  were 
attributable  to  their  utilization  management  program,  another  large  portion  came  from 
negotiated  fee  schedules  that  were  lower  than  pre-managed  care  rates  (Callahan,  Shepard, 
Beinecke,  Larson,  &  Cavanaugh,  1994). 

Because  of  this  difficulty  in  isolating  managed  care  elements,  I  will  combine 
remaining  discussion  of  prepayment  with  utilization  management.  This  grouping  is 
appropriate,  since  the  methods  work  in  a  complementary  fashion.  The  funding  system 
provides  the  important  incentives  to  providers,  and  utilization  management  is  one  way  in 
which  these  incentives  are  translated  down  from  abstract  principles  to  individual 
treatment  plans. 

B.  Analytic  Framework 

The  effects  of  utilization  management  and  prepayment  are  summarized  in  the 

following  framework.  By  focusing  on  the  key  dimensions  of  hypothesized  managed  care 
outcomes  in  the  public  sector  behavioral  health  system  (access,  substitution  of  care, 
under-treatment,  and  cost  shifting)  I  will  show  that  the  effects  of  managed  care  on 
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populations  are  variable.  They  vary  with  the  proportion  of  the  prepayment  amount  to  the 
estimated  utilization  need,  the  accuracy  of  that  estimate,  the  stringency  of  care 
substitution,  monitoring  by  the  payer,  the  ability  of  other  social  services  to  bear  costs,  and 
the  likelihood  that  a  member  of  a  given  population  will  receive  care.  By  somewhat 
arbitrarily  creating  ideal  outcomes  for  all  public  sector  behavioral  managed  care 
programs,  I  will  identify  their  key  evaluation  criteria.  The  following  flowchart 
summarizes  this  framework,  and  will  be  elaborated  on  in  later  sections. 
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Figure  2-1:  A  Flowchart  for  Managed  Care  Evaluation 
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In  this  model,  a  given  condition  (in  boxes)  may  result  in  any  combination  of  the  potential  program 
outcomes  (outcomes  are  not  in  boxes).  Decision  points  suggest  ways  to  empirically  determine  the  success 
of  public  sector  managed  care  programs.  Appropriate  substitution  (in  the  lower  left  corner)  in  the 
presence  of  the  same  or  increased  access  is  the  only  condition  that  will  both  lower  cost  shifting  and  cost 
per  client  served.  As  will  be  discussed  in  Chapter  4,  there  is  no  cost  shifting  data  available  to  distinguish 
between  the  Appropriate  Substitution  and  Over  Substitution  conditions. 
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1)  Access  to  care 

The  simplest  way  to  achieve  savings  in  a  managed  care  plan  is  to  deny  enrollees 
care.  Access  to  care  has  two  dimensions  -  enrollment  in  the  health  insurance  program  so 
that  clients  are  eligible  for  care,  and  clients  actual  likelihood  of  receiving  care. 

The  proportion  of  eligible  people  who  enroll  into  a  heath  insurance  plan  is 
dependent  on  the  managed  care  intervention.  A  capitated  insurer  receives  more  money 
for  each  client  it  enrolls,  creating  an  incentive  to  enroll  a  higher  percentage  of  the  eligible 
population.  For  example,  a  capitated  behavioral  health  system  may  find  it  cost  effective 
to  implement  street  based  outreach  programs  for  people  who  are  homeless,  station 
enrollment  workers  in  a  community  health  center,  or  advertise  on  television.  In  contrast, 
an  insurer  who  receives  a  fixed  payment  regardless  of  the  number  of  clients  it  treats  has 
an  obvious  incentive  to  not  enroll  eligible  people  into  its  insurance  pool. 

a)  Enrollment  Decision  Point 

The  Enrollment  Decision  Point  describes  how  implementing  a  managed  care  plan 

affects  client's  ability  to  enroll  in  health  insurance.  If  a  managed  care  program  reduces 

the  ability  of  eligible  people  to  enroll  in  health  insurance,  it  should  be  considered  a 

negative  outcome.  Reducing  enrollment  for  publicly  funded  insurance  is  especially 

disturbing  since  potential  public  clients  are  unlikely  to  receive  insurance  coverage  from 

other  sources.  A  positive  outcome  is  defined  as  an  insurance  program  covering  a  greater 

proportion  of  its  eligible  population,  or  eligible  clients  staying  enrolled  longer,  or  both  of 

g 

these  dimensions  remaining  constant . 

8  If  an  insurance  covers  more  than  one  group,  this  decision  point  should  be  evaluated  per  specific  target 
population.  For  example,  a  managed  Medicaid  waiver  could  be  implemented  with  a  streamlined 
application  procedure,  thereby  encouraging  more  eligible  people  to  seek  benefits.  However,  it  could  also 
eliminate  street  outreach  programs,  and  result  in  a  lower  enrollment  rate  among  people  who  are  homeless. 


48 


This  dissertation  will  not  be  able  to  address  the  enrollment  issue.  Clients  receive 
GA  behavioral  health  coverage  when  their  welfare  caseworker  awards  them  medical 
benefits.  The  GAP  has  no  say  in  enrollment  on  GA,  or  on  eligibility  criteria  for  GA. 

b)  Receipt  of  Any  Care  Decision  Point 

Enrollment  by  itself  does  not  guarantee  the  second  dimension  of  access:  receipt  of 

care.  Here,  the  key  issue  is  whether  enrollees  had  the  chance  to  become  engaged  in 

treatment.  Therefore,  care  must  include  any  contact,  including  screening  visits  or 

assessments,  with  a  behavioral  health  professional. 

There  are  two  contrasting  theories  on  how  prepayment  may  affect  access  to  any 

type  of  behavioral  health  care.  First,  as  Mechanic  and  colleagues  (1995)  suggest,  an 
insurer  has  powerful  incentives  to  ignore  potentially  high  utilizing  clients,  especially  if 
utilization  is  higher  than  expected,  thereby  leaving  the  insurer  with  a  treatment  pool  of 
less  expensive  clients.  In  contrast,  based  on  the  substitution  argument  described  below, 
some  claim  that  enrollment  and  likelihood  for  receiving  care  should  increase  under 
prepayment  (e.g.  Lehman,  1987;  Reed,  Hargrove  &  Davis  1995) ,  especially  for  under- 
served  groups  like  people  with  serious  mental  illness. 

Evidence  of  capitation  affecting  probability  of  receiving  any  type  of  care  is  also 
limited.  In  an  evaluation  of  capitated  services  for  people  with  serious  mental  illness  in 


Very  few  studies  have  examined  population  based  enrollments.  Dickey  and  colleagues  (1996) 
found  a  slight  increase  in  enrollment  of  schizophrenics  after  the  implementation  of  a  capitated  Medicaid 
waiver,  but  there  was  no  estimation  of  a  denominator  population  of  the  total  number  of  eligible 
schizophrenics  in  the  state.  The  likelihood  of  clients  remaining  enrolled  in  the  insurance  plan  is  even  less 
clear.  One  study  of  disabled  clients  in  a  general  population  found  duration  of  enrollment  among  people 
with  psychiatric  disabilities  similar  to  that  of  people  with  physical  disabilities  (McFarland,  Johnson  & 
Hornbrook,  1996).  In  contrast,  in  another  private  insurance  pool,  clients  with  major  depression  were  more 
hkely  to  switch  out  of  their  HMO  than  their  fee-for-service  counter  parts  (Sturm,  McGlynn,  Meredith 
Wells,  Manning  &  Rogers,  1994;  Sturm,  Jackson,  Meredith,  Yip,  Manning  Rogers  &  Wells  1995) 
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Arizona,  Leff  and  colleagues  (1994)  found  a  slight  increase  in  probability  of  use  and 
appropriateness  of  treatment  for  the  capitated  program  compared  to  the  fee-for-service 
baseline.  In  the  Massachusetts  capitated  Medicaid  behavioral  health  carve  out,  there  is 
no  evidence  of  any  changes  in  probability  of  use  (Dickey,  Normand,  Norton,  Azeni, 
Fisher  &  Altaffer,  1996;  Callahan,  Shepard,  Beinecke,  Larson  &  Cavanaugh,  1994).  In 
light  of  this  conflicting  theory  and  evidence,  and  as  reflected  in  the  model  under  the 
Receipt  of  Any  Care  Decision  Point,  enrollee  access  to  any  type  of  care  may  increase  or 
decrease  in  response  to  managed  care. 

2)  Utilization  Decision  Point 

Managed  care  not  only  affects  the  likelihood  of  a  person  getting  care,  but  also  the 

kind  of  care  that  they  will  receive.  In  public  sector  behavioral  health,  utilization 
management  reallocates  resources  by  substituting  high  intensity  services  with  low 
intensity  services.  By  itself,  total  (program)  direct  costs  are  a  poor  indicator  of  the 
appropriateness  of  substitution,  because  direct  costs  are  also  affected  by  the  total  number 
and  type  of  clients  served.  Utilization  must  be  judged  on  a  client  and  sub-population 
basis.  The  Utilization  Decision  Point  in  Figure  2-1  graphically  represents  the  four 
possible  affects  of  managed  care  on  utilization  of  behavioral  health  services. 

Starting  from  the  bottom  right  of  the  flowchart,  the  managed  care  program  may 
have  no  effect  on  utilization  patterns,  though  it  is  hard  to  imagine  a  managed  care  plan 
that  would  intend  to  not  affect  treatment  patterns. 

Moving  one  box  in  the  Figure  to  the  left,  if  a  population  were  grossly  under-served,  a 
managed  care  intervention  may  result  in  increased  intensity  of  service.  Increased 
intensity  could  manifest  itself  in  several  ways:  increased  use  of  inpatient  services  while 
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outpatient  care  rates  remained  stable;  increased  use  of  outpatient  care  services  while 
inpatient  care  rates  remained  stable;  or  some  change  in  both.  The  best  way  to  determine 
equivalence  between  these  different  care  types  is  by  using  total  costs  of  services,  though 
the  effect  of  these  cost  increases  should  have  measurable  non-fiscal  impacts  as  well. 

Care  intensity  may  increase  when  expanding  eligibility  or  actively  engaging 
populations  into  treatment  who  previously  had  no  access  to  treatment  -  for  example, 
providing  managed  care  services  to  people  who  are  homeless,  where  we  would  expect  to 
see  improved  clinical  outcomes,  higher  direct  costs  per  client,  and  reduced  cost  shifting. 
Serious  errors  in  formation  of  a  managed  care  plan,  such  as  inappropriate  financing 
incentives  or  rigid  network  management,  could  theoretically  inappropriately  increase 
inpatient  care  for  clients.  Under  current  notions  of  community  based  treatment 
(Morrissey  &  Goldman,  1984;  Turner  &  TenHoor,  1978),  unwarranted  increases  in 
inpatient  services  may  be  considered  poor  care  because  it  could  decrease  the  ability  of  a 
client  to  function  in  the  community. 

Over  substitution,  or  under  treating  clients  with  too  heavy  a  reliance  on  low 
intensity  services,  will  also  result  in  poorer  clinical  outcomes  and  increased  cost  shifting, 
and  potentially  lower  direct  costs  per  client.  Over  substitution  is  a  real  danger  in  many 
managed  care  plans.  For  example,  Thompson  and  associates  (1992)  found  in  their 
evaluation  of  a  capitation/utilization  management  program  that  outpatient  care  was 
regularly  a  substitute  for  inpatient  psychiatric  care  and  inpatient  detoxification.  Over 
substitution  may  have  occurred  in  the  initial  Arizona  behavioral  long-term  care 
demonstration  where  services  were  offered  to  more  clients  without  a  proportional 
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increase  in  funding  (1989)9.  In  the  Rand  Medical  Outcomes  study,  too  few  services 
provided  by  HMOs  may  have  lead  clients  with  major  depression  to  disenroll  (Sturm, 
Jackson,  Meredith,  Yip,  Manning,  Rogers  &  Wells,  1995;  Rogers,  Wells,  Meredith, 
Sturm  &  Burnam,  1993).  Further,  though  Stroup  and  Do  wart  (1995)  found  no  evidence 
of  cost  shifting  to  the  State  Mental  Health  Authority  in  an  early  evaluation  of  the 
Massachusetts  Medicaid  program,  Dickey  and  associates  (1996)  found  its  savings  on 
inpatient  services  for  schizophrenic  patients  were  offset  by  increased  bed  days  in  State 
Mental  Health  Authority  facilities.  However,  both  Massachusetts  evaluations  found  no 
increase  in  emergency  department  utilization. 

The  condition  on  the  far  left,  Care  Substitution,  may  have  positive  effects  on  the 
population  eligible  for  care.  It  is  the  only  condition  that  clearly  improves  the  care  system 
because  it  reduces  cost  shifting  while  maintaining  or  improving  clinical  outcomes  and 
direct  costs  per  client. 

There  is  some  evidence  that  managed  care  can  result  in  appropriate  substitution. 
It  may  have  occurred  in  the  Minnesota  experiment,  were  there  was  no  significant 
difference  between  fee-for-service  and  capitation  clients  with  serious  mental  illness  in 
terms  of  general  health  and  psychiatric  symptoms  (Lurie,  Moscovice,  Finch, 
Christianson,  &  Popkin,  1992).  Similarly,  in  the  Monroe-Livingston  experiment, 
capitated  clients  had  fewer  inpatient  treatment  days,  but  no  had  differences  from  the  fee- 
for-service  baseline  clients  in  functioning  or  levels  of  symptoms  (  Cole,  Reed,  Babigian, 
Brown  &  Fray,  1994;  Reed,  Hennessy,  Mitchell,  &  Babigian,  1994). 


9  Though  the  same  author  later  argued  that  the  potential  harm  of  a  low  capitation  rate  was  offset  by 
advocacy  (Santiago,  1990). 
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The  clearest  indicators  of  the  quality  of  substitution  (deciding  between  the  over 
substitution  and  appropriate  substitution  boxes  in  Figure  2-1)  are  cost  shifting  and  clinical 
outcomes.  The  GAP  is  designed  to  substitute  care,  but  it  may  do  so  while  reducing 
clinical  standards,  or  by  forcing  GA  recipients  to  seek  behavioral  health  treatment  from 
providers  that  the  GAP  cannot  control  (e.g.  clients  detoxifying  in  emergency  rooms,  or 
receiving  psychotropic  medication  from  primary  care  physicians).  As  will  be  discussed 
in  the  Methods  chapter,  no  available  data  can  judge  cost  shifting  and  clinical  outcomes, 
so  this  Dissertation  will  only  be  able  to  determine  if  care  substitution  has  occurred,  but 
will  not  be  able  to  judge  the  quality  of  that  substitution. 

C.  Implications  of  the  framework 

This  evaluation  framework  suggests  two  advances  for  public  sector  managed  care 

evaluations.  First,  by  focusing  on  outcomes  of  entire  populations,  rather  than  on  just  the 
outcomes  of  people  served,  the  framework  operationalizes  the  crucial  role  of  the  public 
sector  as  payer  and  provider  of  last  resort.  Second,  by  defining  population  outcomes  as 
dependent  on  change  in  access  and  on  care  substitution,  the  framework  suggests  discrete 
goals  for  managed  care  programs  to  follow. 

However,  these  are  just  goals  -  not  expected  findings.  One  thing  that  is  clear 
from  the  managed  care  literature  is  that  managed  care  outcomes  vary  considerably,  and 
the  evidence  for  theories  surrounding  managed  care  are  weak.  Part  of  the  reasons  for  this 
ambiguity  are  the  evaluation  methods  themselves.  Many  public  sector  managed  care 
evaluations  are  mandatory  HCFA  reviews  as  part  of  managed  Medicaid  waivers  (e.g. 
Rohland,  1997).  However,  quality  assurance  and  program  monitoring  efforts  are  not 
evaluations  (Wells,  Astrachan,  Tischler,  &  Unutzer,  1995),  but  are  rather  designed  to 
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answer  the  question  'given  this  program,  how  can  we  make  it  better'.  In  contrast, 
evaluations  ask  'should  this  program  continue',  and  'should  this  program  be  replicated 
elsewhere'.  In  other  words,  true  evaluations  focus  on  generalization. 

Evaluating  managed  care  programs  are  difficult  because  they  are  multi-faceted 
interventions,  and  involve  making  many  specific  changes  simultaneously  to  essentially 
unique  services  systems.  Strategies  like  utilization  management  or  capitation  are  merely 
descriptors,  but  do  not  define  level  of  restriction,  staff  skill,  provider  supply,  etc.  that 
make  these  mechanisms  work  in  a  practical  way.  The  variation  that  can  occur  in 
implementing  these  mechanisms,  as  well  as  the  variation  inherent  in  each  service  system 
being  studied,  result  in  varied  managed  care  outcomes. 

In  fact,  the  unit  of  analysis  for  managed  care  evaluations  are  always  a  system  or 
systems  of  care,  and  these  evaluations  can  only  be  interpreted  as  case  studies.  Therefore, 
extreme  success  or  failure  can  define  reasonable  limits  on  expectations  for  the  managed 
care  intervention,  but  not  necessarily  the  probable  success  of  the  intervention  itself  (Yin, 

1994)  . 

D.  Managed  care  effects  on  minority  enrollees 

Various  ethnic  and  racial  groups  may  be  differentially  affected  by  managed  care. 

Some  of  these  differences  may  carry  over  from  pre-managed  care  health  systems.  For 
example,  African  Americans  have  been  known  to  experience  different  health  treatment 
for  substance  abuse  and  personality  disorders  in  inpatient  psychiatric  hospitalization 
(Chung,  Mahler  &  Kakuma,  1995)  and  for  outpatient  psychotherapy  (King  &  Williams, 

1995)  .  Managed  care  is  thought  to  both  exacerbate  and  relieve  some  of  these  disparities. 
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Provider  network  composition  may  disproportionately  limit  access  to  any  care  by 
decreasing  geographic  access  or  cultural  appropriateness  of  providers  to  some  ethnic 
groups  (Rosenbaum,  Serrano,  Maga  &  Stern,  1997;  Schlesinger,  Thomas,  Druss  &  Allen, 
1998).  This  effect  is  unlikely  to  play  out  in  the  GAP,  as  the  pool  of  available  providers 
has  changed  little  after  implementation,  other  than  increasing  the  role  of  the  LMHA. 

The  impact  of  managed  care  in  reducing  client  provider  contact  time  may  also 
differentially  effect  racial  and  ethnic  minority  groups.  Minority  managed  care  recipients 
were  found  to  be  less  satisfied  than  their  white  counterparts  with  completeness  and 
coordination  of  treatment,  and  clinical  interactions  and  communication  with  their 
providers  (Schlesinger,  Thomas,  Druss  &  Allen,  1998). 

This  effect  may  also  not  be  relevant  to  the  GAP,  at  least  in  terms  of  accessing  care.  The 
GAP  screening  process  is  designed  to  increase  the  length  of  provider  contact  (at  least  at 
first  contact)  for  all  recipients,  minimize  geographic  barriers,  and  indirectly  train  GA 
caseworkers  in  making  more  accurate  referrals  for  behavioral  health  services. 

Managed  care  may  also  work  to  minimize  racial  disparities  in  utilization. 
Utilization  management  can  potentially  minimize  differences  in  treatment  by  race  or 
ethnicity  by  standardizing  decisions  about  type  and  intensity  of  treatment  (Schlesinger, 
Gray  &  Perreira,  1997). 

Though  many  of  these  differences  are  attributed  to  service  system  characteristics, 
some  minority  groups  may  have  differing  thresholds  of  illness  before  they  seek  formal 
treatment,  or  have  underlying  needs  for  service  different  from  majority  groups  with 
similar  socioeconomic  or  exposure  conditions  (Williams  &  Collins,  1995).  Because  of 
this  ambiguity,  it  is  easiest  to  determine  if  managed  care  differentially  changes  minority 
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group  experience  in  reference  to  the  same  service  system  before  managed  care.  This 
potential  change  will  be  discussed  in  later  chapters. 

5.  Conclusions 

The  themes  common  to  most  attempts  to  improve  public  sector  behavioral  health 
services  -  that  of  cutting  costs  by  controlling  utilization,  and  improving  quality  by  better 
targeting  and  integrating  services,  draw  their  intellectual  roots  from  both  the  service 
integration  and  managed  care  literatures.  For  example,  the  Monroe-Livingston  capitation 
experiment  was  not  designed  as  a  cost  control  program,  but  instead  its  primary  objective 
was  to  increase  flexibility  of  these  local  service  systems  (Hoge,  Jacobs,  Thakur,  & 
Griffith,  1998).  It  emphasized  earlier  themes  on  improving  service  quality  through 
integrative  mechanisms  (such  as  was  done  in  the  RWJ  Nine  Cities  initiative),  but  did  so 
fairly  successfully  by  using  more  modern  capitation  techniques. 

The  evaluation  framework  described  in  this  chapter  will  serve  as  the  analytic 
focus  for  much  of  this  dissertation,  including  discussions  about  access  to  care, 
substitution  of  care,  and  client  subgroupings  based  on  race  and  diagnosis.  Other  parts  of 
the  dissertation  will  focus  more  on  organizational  analyses  of  traditional  service 
integration  methods.  The  following  chapter  gives  a  detailed  description  of  the  GAP  to 
support  both  themes  and  suggest  testable  hypotheses. 
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Chapter  3:   Program  Description  and  Hypotheses 

Like  most  current  public  sector  managed  behavioral  health  care  programs,  the 
GAP  stresses  both  cost  control  and  quality  improvement,  and  does  so  by  concurrently 
implementing  traditional  organizational  interventions  and  traditional  managed  care 
interventions.  This  chapter  attempts  to  focus  and  integrate  the  preceding  reviews  of  both 
literatures  by  applying  them  to  the  GAP  evaluation. 

1.  General  Description  of  the  GAP  model 

A.  Accessing  services  and  managing  utilization  prior  to  the  GAP 

The  way  that  GA  recipients  interact  with  the  behavioral  health  care  system  are 

complicated.  The  are  several  distinct  actors  and  circumstances  that  affect  the  two 
decisions  described  in  the  evaluation  framework  (Figure  2-1) — access  and  utilization. 
Before  the  GAP,  the  only  actors  of  consequence  affecting  access  to  care  and  type  of  care 
received  were  the  client,  provider(s),  and  GA  caseworkers.  The  GAP  adds  additional 
complexity  to  this  model. 

The  decision  making  process  can  be  broken  down  into  discrete  stages.  Client 
flow  charts,  presented  below,  clearly  lay  out  the  actors,  decisions,  and  the  order  in  which 
they  are  made.  The  following  figure  describes  the  process  through  which  active  GA 
enrollees  accessed  behavioral  health  services  before  the  GAP.  It  presents  the  service 
model  for  all  three  GAP  sites  before  implementation  of  the  GAP. 
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Figure  3-1:  Pre-GAP  model 
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This  flowchart  shows  the  process  through  which  GA  Clients  seek  and  receive  behavioral  health 
care  before  the  GAP  was  implemented.  Clients  may  self  refer  to  a  provider,  or  be  referred  to  a  provider  bv 
their  GA  caseworker.  If  the  referral  is  based  on  the  suspicion  of  substance  abuse  problems,  a  client 's  cash 
benefits  hinge  on  the  client  following  through  with  that  referral.  Clients  may  end  up  not  receiving  any 
behavioral  health  care,  or  receive  treatment  for  a  behavioral  health  problem  from  a  non-  behavioral  health 
provider  (such  as  an  emergency  room  for  an  overdose). 


As  the  above  figure  shows,  the  client,  provider,  and  GA  caseworker  all  played  a 
role  in  deciding  what  type  and  intensity  of  behavioral  health  services  a  client  received. 
Caseworkers  recommended  treatment  or  specific  providers.  In  the  case  of  substance 
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abuse  treatment,  their  recommendations  could  have  been  mandatory.  Providers  could 
turn  away,  wait  list,  or  refer  clients  to  other  providers  if  they  are  fully  booked,  do  not 
offer  the  right  type  of  service,  or  are  discouraged  by  the  low  reimbursement  rates  or 
difficult  nature  of  GA  cases.  Clients  may  self-limit  utilization  due  to  difficulties  in 
accessing  treatment,  such  as  transportation  problems  or  wait  times,  or  resistance  to 
treatment.  Combined,  these  three  decision  factors  correspond  to  the  more  global  issue  of 
a  client  accessing  any  behavioral  health  service,  which  was  addressed  in  the  previous 
chapter. 

However,  other  than  cursory  by  GA  caseworkers  with  high  caseloads  and  little 
formal  training  in  behavioral  health,  there  were  no  limits  on  utilization,  and  no  attempts 
at  service  coordination  or  case  management.  The  client,  perhaps  in  consultation  with  a 
GA  caseworker,  decided  what  type  of  provider  the  client  should  see,  and  the  client  and 
provider  decided  what  level  of  care  the  client  would  receive.  In  aggregate,  these 
processes  equate  to  the  decision  about  the  type  and  intensity  of  services  a  client  received 
that  was  discussed  in  the  previous  chapter. 

Clients  needing  behavioral  health  services  but  not  receiving  them  are  described  in 
the  flow  chart  with  the  oval  "no  utilization  or  a  behavioral  health  substitute".  For 
evaluation  purposes,  a  behavioral  health  substitute  is  any  service  a  client  seeks  or 
receives  in  response  to  behavioral  health  complaint  that  is  not  delivered  by  a  traditional 
behavioral  health  provider.  Examples  of  substitution  include  visits  to  a  primary  clinician 
or  emergency  department.  However,  such  data  were  not  available  for  this  evaluation. 
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B.  Generic  GAP  Model 

The  GAP  was  created  to  address  some  of  the  problems  with  the  baseline  model  in 

accessing  care  and  controlling  utilization.  Below  is  a  generalized  model  of  GAP  client 
flow  and  utilization  management.  This  model,  in  its  attempts  to  generalize  and  simplify, 
does  not  completely  describe  any  of  the  three  sites  (which  will  be  discussed  later).  It  is, 
however,  useful  for  contrasting  with  the  previous  Baseline  services  model  and 
introducing  important  concepts  about  these  complex  programs. 
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Figure  3-2:  Generic  GAP  model 
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This  flowchart  includes  specific  GAP  decision  making  mechanisms  for  triage/case  management  and 
utilization  management  (both  indicated  by  rounded  diamonds).  Diamonds  with  hard  angles  represent 
decisions  that  affect  the  type  of  care  that  clients  receive  and  the  likelihood  of  clients  receiving  any  care  at 
all. 
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1)  Client  Flow  Overview 

Under  the  GAP,  the  GA  caseworker  can  no  longer  refer  clients  to  providers,  but 

can  only  refer  a  client  to  the  GAP.  GA  caseworkers  are  in  a  good  position  to  make  these 
referrals,  because  the  client  will  see  their  GA  caseworker  first  to  learn  of  their  eligibility 
of  medical  benefits,  and  either  the  caseworker,  client,  or  both,  may  decide  to  have  the 
client  screened  by  the  GAP.  If  a  GA  caseworker  refers  the  client  to  GAP  screening 
because  the  caseworker  feels  the  client  may  have  a  drug  problem,  this  referral  is  a 
mandatory  condition  of  receiving  cash  benefits.  If  a  provider  feels  a  client  referred  by  the 
GAP  is  inappropriate  for  their  offered  services,  or  if  GAP  utilization  review  refuses  the 
provider  request  for  treatment,  the  client  may  be  sent  back  to  GAP  screening  for  a  more 
through  assessment  and  a  treatment  plan. 

Clients  referred  to  the  GAP  may  not  actually  reach  the  GAP,  and  may 
consequently  end  up  receiving  no  treatment  or  treatment  from  some  behavioral  health 
alternative.  The  geographic  convenience  of  collocation  is  intended  to  reduce  this 
likelihood,  at  least  for  referrals  from  GA  caseworkers.  Clients  not  referred  to  the  GAP  at 
the  welfare  office  may  still  self-refer  to  the  GAP,  another  DMHAS  facility,  or  a  private 
provider  at  any  time. 

2)  GAP  Triage 

At  GAP  screening/case  management,  clients  are  screened,  and,  if  they  need  any 
treatment,  an  initial  service  plan  is  generated  for  each  client.  The  GAP  staff  oversees  the 
client's  behavioral  health  care  utilization  including  care  not  provided  by  GAP  staff.  As 
will  be  discussed,  the  GAP  may  refer  the  client  to  outside  network  providers  or  to  other 
DMHAS  providers  (generally  different  treatment  units  of  the  same  LMHA).  The  GAP 
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team  itself  will  provide  some  degree  of  case  management  services,  such  as  brief 
treatment  or  entitlement  screening  and  application  assistance. 

3)  Managed  care  strategies 

GAP  sites  attempt  to  limit  and  focus  behavioral  health  services  through  a  loose 

preferred  provider  network  and  a  prior  authorization  model  of  utilization  management. 

Private  providers  receive  payment  from  GA  on  a  fee-for-service  basis.  Since  GA 

payment  consists  of  80%  state  funds,  state  run  facilities  do  not  submit  bills  to  GA.  The 

three  GAP  sites  studied  are  all  part  of  state  run  LMHAs,  and  their  global  GAP  budget  is 

intended  to  cover  GA  client  treatment  costs  incurred  by  LMHAs  and  DMHAS.  Clients 

do  not  share  any  costs  of  their  non-residential  care,  though  for  residential  care  (e.g.  a  half 

way  house  for  substance  abuse  treatment),  their  cash  benefits  are  turned  over  to  the 

residential  provider  by  GA  to  cover  the  clients'  room  and  board.  This  'cost  sharing' 

policy  has  been  in  effect  since  before  the  creation  of  the  GAPs. 

GAPs  established  networks  of  community  providers  who  could  offer  behavioral 

health  services  to  clients  and  give  network  members  preference  when  referring  clients  to 

outside  treatment.  In  most  cases,  the  networks  have  grown  to  include  into  every  local 

provider  willing  to  treat  both  GA  clients  and  comply  with  the  administrative  requirements 

placed  on  them  by  GAP  Utilization  Management.  Certain  providers  have  formal 

agreements  with  GAPs  for  special  conditions  (e.g.  reserved  treatment  slots  or  discounted 

service  charges). 

GAP  Utilization  Management  typically  interacts  with  outside  providers  in  two 
circumstances.  First,  each  episode  of  treatment  delivered  by  an  outside  provider  must 
have  prior  authorization  from  a  GAP  Utilization  Management  or  their  claim  will  not  be 
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paid  by  GA.  Frequently,  providers  negotiate  requests  with  Utilization  Management,  and 
the  initial  request  may  be  modified  in  some  way  (e.g.  an  authorization  for  fewer  visits 
than  initially  requested).  Less  often,  Utilization  Management  may  reject  a  request  and 
the  provider  may  not  offer  an  acceptable  substitute.  In  such  cases,  if  the  client  is  stable 
enough  to  be  discharged,  the  client  will  be  referred  back  to  the  GAP  for  a  more  thorough 
screening  and  treatment  plan. 

4)  GAP  Exit 

Clients  exit  the  GAP  program  by  losing  GA  medical  benefits,  and  from  there,  the 
clients  can  either  remain  in  treatment  with  the  LMHA10  (if  they  meet  target  population 
definitions)  or  they  are  lost  to  the  system.  Clients  leave  GA  by  failing  to  comply  with  the 
re-determination  process,  or  becoming  categorically  ineligible  for  GA  medical  ~  which 
occurs  by  receiving  Social  Security  or  other  federal  entitlements,  finding  a  job, 
incarceration,  death,  or  change  in  town  of  residence.  However,  these  events  are  rare,  and 
enrollment  on  General  Assistance  medical  benefits  is  fairly  stable. 

5)  Integrating  the  GAP  model  with  the  evaluation  framework 

The  three  GAP  sites  have  introduced  the  collocated  LMHA  staff  at  welfare  offices 

to  strengthen  the  screening,  engagement,  treatment  planning  and  service  coordination  for 
behavioral  health  services  of  GA  medical  enrollees.  The  GAP  sites  have  also 
implemented  some  form  of  control  on  utilization,  so  LMHA  and/or  community  based 
behavioral  health  providers  must  justify  their  treatment  decisions  to  the  GAP  before  GA 
will  pay  for  claims. 

10  Of  the  sites  studied,  only  the  Bridgeport  LMHA  seems  to  have  rigid  enough  definitions  to  turn  away  the 
typical  GAP  clients  with  mental  illness,  since  Bridgeport  does  not  treat  clients  with  only  personality 
disorders.  However,  until  the  GAP  was  implemented,  most  GA  clients  never  sought  or  received  any 
service  from  their  LMHAs. 
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Changes  in  the  way  GA  clients  access  behavioral  health  care  from  the  Baseline 
include  adding  the  screening  element  of  the  GAP,  and  reducing  the  potential  loss  rate  of 
clients  by  collocating  GAP  workers  at  the  welfare  building.  Under  the  GAP,  GA 
caseworkers  no  longer  directly  refer  clients  to  behavioral  health  treatment,  but  rather 
refer  the  client  to  mental  health  clinicians  in  the  'GA  Triage/  Case  Management' 
diamond,  who  may  make  clinical  referrals  after  a  thorough  screening.  If  the  GAP  works 
as  designed,  a  greater  proportion  of  GA  enrollees  will  receive  some  form  of  behavioral 
health  care  after  implementation  of  the  GAP. 

Other  changes  from  Baseline  affect  the  type  and  intensity  of  behavioral  health 
care  the  client  receives.  In  the  Baseline  model,  the  GA  caseworker  and  the  provider  were 
the  only  professional  input  on  the  type  of  care  a  client  received.  The  client  had 
considerable  control  over  what  care  they  received,  under  the  logic  that  providers  were 
unlikely  to  turn  people  away  even  if  they  were  less  than  ideal  candidates  for  the  range  of 
services  a  provider  could  offer. 

After  the  implementation  of  the  GAP,  neither  patient  nor  provider  has  final 
control  over  treatment  recommendations,  and  the  GA  caseworker  has  no  input  at  all. 
Instead,  this  authority  has  been  turned  over  to  the  GAP  triage  units,  which  develop 
comprehensive  treatment  plans,  and  the  utilization  management  component  of  the  GAP, 
which  must  approve  all  utilization.  The  GAP  Utilization  Management  and  provider  have 
the  most  influence  on  the  type  of  care  people  receive,  and  the  Utilization  Management  is 
theoretically  strong  enough  to  deny  all  utilization  from  a  provider  when  a  client  has  self- 
referred  incorrectly.  However,  Utilization  Management  at  all  sites  seem  to  lack  sufficient 
bargaining  power  to  enjoy  this  level  of  decision  making  in  all  situations  (this  issue  will  be 
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discussed  in  greater  detail  later).  Client's  initial  choice  of  provider  still  seems  to  play 
some  role  in  the  type  of  care  that  is  eventually  authorized,  so  clients  continue  play  some 
role  in  the  type  of  utilization  they  receive. 

C.  Managed  Care  Hypotheses 

Screening  and  Utilization  Management  together  are  intended  to  improve  access  to 

any  type  of  behavioral  health  care  and  encourage  use  of  low  intensity  services,  while 
maintaining  or  improving  quality  of  care.  Specifically,  these  changes  should  result  in  the 
following  outcomes,  as  suggested  by  the  theoretical  framework,  though  some  of  these 
outcomes  are  untestable  with  available  data: 

1 .  A  greater  proportion  of  GA  enrollees  will  have  contact  with  behavioral  health 
professionals  after  implementation  of  the  GAP; 

2.  The  GAP  will  result  in  lower  rates  of  inpatient  care  and  substitute  less  intensive 
community  based  alternatives; 

3.  The  GAP  will  lower  behavioral  health  costs  per  client; 

4.  The  GAP  will  decrease  use  of  behavioral  health  substitutes  (such  as  Emergency 
department  visits)  (untestable); 

5.  The  will  result  in  improved  clinical  outcomes  for  GA  clients  (untestable). 

The  data  to  explore  these  hypotheses  come  from  analyses  of  DMHAS  electronic 
clinical  record  and  City  GA  Rosters.  Available  data  is  sufficient  to  partially  explore 
hypotheses  1  through  3,  only  in  terms  of  DMHAS  care.  Quantitative  data  is  only 
available  from  Hartford  and  New  Haven. 

Available  data  limits  exploring  access  to  care  to  DMHAS  services  only.  The 
GAP  should  increase  rates  of  first  contact  with  DMHAS  clinicians,  which  includes  GAP 
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screening.  Obviously,  GA  caseworkers  could  increase  access  to  care  by  referring  every 
GA  recipient  to  the  GAP.  However,  not  every  GA  client  would  benefit  from  a  clinical 
screening,  and  unnecessary  referrals  would  be  wasteful.  Procedural  differences  across 
time  and  sites  (see  site  descriptions  below)  may  affect  the  accuracy  of  GA  caseworker 
referrals.  Secondary  analyses  of  access  data  will  also  be  conducted  to  determine  the 
efficiency  of  any  screening  increase. 

Utilization  decisions  will  be  partially  explored  by  testing  hypotheses  2  and  3 
(substitution  of  care  types  and  costs  of  services),  but  again,  only  in  reference  to  DMHAS 
provided  services.  As  will  be  discussed  in  the  Methods  chapter,  these  two  outcomes  will 
be  combined  by  modeling  changes  in  the  relative  intensity  of  DMHAS  resources  that 
subjects  used  before  and  after  GAP  implementation.  This  analysis  will  be  able  to 
determine  if  any  substitution  of  care  has  occurred,  but  not  be  able  to  determine  the  quality 
of  that  substitution. 

While  the  GAP  may  result  in  changes  for  the  GA  population  as  a  whole,  Chapter 
2  also  presented  literature  suggesting  that  managed  care  may  differentially  affect 
minority  groups.  Because  of  the  GAPs  unusually  intense  focus  on  intake  and  service 
coordination,  it  is  unlikely  that  GAP  implementation  will  worsen  racial  or  ethnic 
disparities. 

The  GAP  adds  mechanisms  to  standardize  both  access  and  utilization.  The 
process  of  collocation  included  some  training  of  GA  caseworkers  that  may  standardize 
their  referral  to  the  GAP.  Further,  collocation  equally  removes  geographic  barriers  to 
access  that  may  have  existed  differentially  before  the  GAP.  Unfortunately,  only  the 
Hartford  data  set  is  rich  enough  to  allow  exploration  of  racial  differentials  in  access. 
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Formal  utilization  management  should  standardize  utilization  patterns  and 
minimize  racial  and  ethnic  differences  in  treatment  that  may  have  existed  before  the 
GAP.  Of  course,  this  standardization  across  racial  groups  can  only  occur  if  the  GAP 
mechanisms  have  any  effect  at  all.  These  issues  will  be  explored  in  greater  detail  in  the 
methods  chapter. 

2.  Site  Descriptions 

These  above  hypotheses  look  at  overall  effects  of  the  generic  GAP  model,  but 
more  detailed  comparisons  are  possible.  The  variation  in  the  GAP  model  across  the  three 
sites  is  dramatic  enough  to  enrich  the  discussion  of  quantitative  results,  as  well  as  explore 
several  organizational  questions.  After  a  detailed  description  of  each  site,  these  intersite 
questions  will  be  presented. 

The  three  GAP  sites  being  evaluated,  Bridgeport,  Hartford,  and  New  Haven,  all 
vary  from  the  Generic  GAP  model  and  each  other  in  important  ways.  This  inter-site 
variation  will  affect  the  outcomes  for  all  of  the  hypotheses,  as  well  as  provide  valuable 
insight  into  the  organizational  aspects  for  the  GAP  model. 

As  the  generic  model  suggests,  the  GAP  design  is  complex--  though  LMHAs  play 
the  primary  leadership  role  in  the  GAP,  they  are  partners  with  City  Welfare  agencies. 
The  following  section  gives  a  detailed  description  for  the  three  sites  as  background  for 
this  dissertation.  Section  three  summarizes  the  key  differences  between  each  site.  Data 
collection  procedures  used  to  compile  these  descriptions  are  explained  in  the  methods 
chapter. 
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Figure  3-3: 


Bridgeport  GAP  client  flow 
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In  contrast  with  the  other  two  study  sites,  Bridgeport  uses  a  gatekeeper  model.  Also,  note  this  figure  has  no 
spaces  indicating  utilization  management.  However,  Bridgeport  does  require  that  all  new  non-emergency 
cases  be  screened  by  the  GAP. 
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B.  Hartford 

The  Hartford  Pilot  program  is  a  division  of  the  Hartford  state  run  LMHA  called 
the  Capitol  Region  Mental  Health  Center.  Its  annual  budget  is  approximately  $2.7 
million,  and  is  the  largest  of  all  the  Pilot  sites.  Most  of  the  GAP  staff  are  permanently 
housed  at  the  LMHA.  It  also  has  3  case  managers,  2  assessment  workers  and  1  secretary 
stationed  in  offices  at  the  city  welfare  building,  which  is  adjacent  to  the  LMHA  and  on 
the  same  campus. 

Hartford  GA  was  the  only  city  sampled  that  mailed  out  GA  benefit  checks,  and 
did  so  until  after  October  1996.  Before  that  time,  clients  did  not  have  to  visit  the  welfare 
office  as  often  as  they  do  in  the  other  cities1 Hartford  GA  is  divided  into  intake  units 
(which  determine  eligibility)  and  treatment  units.  Welfare  treatment  units  evolved  out  of 
units  dedicated  to  city  catchment  areas  and  are  not  differentiated  by  client  need.  Instead, 
they  offer  the  same  range  of  services  to  roughly  the  same  mix  of  clients  per  unit.  The 
average  case  load  is  300  clients  to  one  caseworker.  There  is  one  specialty  treatment  unit, 
called  Project  START,  which  provides  more  intensive  casework  services  (client  to  staff 
ratio  of  150: 1)  to  clients  with  substance  abuse  problems.  Project  START  handles  all 
primary  substance  abuse  case  management  for  the  city,  and  the  GAP  has  no  official 
responsibility  for  substance  abuse  clients  (though  it  does  for  dually  diagnosed  clients). 


A  Grand  Jury  report  (Spada,  1994)  on  Hartford  police  corruption  made  dramatic  claims  about  GA  fraud 
in  the  city,  and  recommended  that  the  city  stop  mailing  out  checks.  The  Spada  report's  assertions  about  the 
Hartford  GA  system  warrant  mention.  The  relevant  claims,  listed  on  pages  3-4  are: 
"(4)  That  virtually  all  drug  users  in  the  City  are  on  public  assistance..." 
"(5)  That  drug  users  sustain  and  exacerbate  their  addiction  from  public  assistance  monies;" 
"(6)  That  numerous  drug  sellers,  not  withstanding  their  profits,  access  welfare  to  gain  advantage  of  the 
states  Medicaid  card;" 

"(7)  That  fraud  in  the  application  and  receipt  of  welfare  is  rampant  and  wide  spread;" 

"(9)  That  drug  sales  in  the  City  double  on  the  1st  and  16th  days  of  each  month  responding  to  the 

distribution  of  welfare  checks." 

Despite  strong  criticism  for  methodological  flaws,  this  report  has  influenced  discussion  about  GA 
reform  since. 
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1)  Hartford  Intake 

The  Hartford  GA  is  the  primary  intake  mechanism  into  the  GAP.  Some  clients 
self  refer,  and  others  are  referred  to  the  GAP  by  outside  health  providers.  Most  referrals 
for  care  come  from  GA  case  workers,  the  LMHA  mobile  crisis  service,  and  network 
providers. 

Some  senior  GAP  staff  feel  the  intake  process  is  a  weak  aspect  of  the  Hartford 
GAP.  In  the  initial  GAP  design,  the  primary  intake  into  the  GAP  came  from  treatment 
unit  caseworkers  (who  create  client  service  plans)  to  the  GAP.  However,  they  felt 
referral  numbers  were  so  low  that  the  GAP  arranged  to  have  clients  come  directly  from 
intake  units  as  well.  Despite  training  from  the  GAP  clinical  staff,  they  claimed  only 
about  50%  of  clients  from  intake  units  were  part  of  the  target  population  for  the  pilot,  so 
the  GAP  went  back  to  taking  clients  from  the  treatment  units. 

The  Hartford  GAP  intake  interview  lasts  about  two  hours,  which  is  the  most 
intensive  of  all  the  sites.  After  intake,  clients  receive  a  treatment  plan  and  start 
treatment.  Clients  that  appear  to  have  complex  clinical  needs  or  may  be  hostile  are 
usually  screened  directly  by  the  GAP  Clinical  Director,  instead  of  the  GAP  line  staff. 

The  GAP  runs  its  own  brief  treatment  unit,  which  offers  mostly  group  therapy  for 
GA  clients.  The  Unit,  is  similar  to  Bridgeport's,  but  Hartford  staff  do  stress  its 
importance  in  the  treatment  engagement  process  as  the  Bridgeport  staff  did. 

Hartford  also  runs  entitlement  assistance  and  vocational  services,  which  usuallv 
consists  of  one  dedicated  staff  member  for  each  service.  However,  these  positions  are  not 
always  filled  and  duties  are  diffused  among  other  GAP  staff. 
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Figure  3-4:  Hartford  GAP  client  flowchart 
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A  close  inspection  reveals  the  following  key  client  flow  and  utilization  management  differences  between 
Hartford  and  the  generic  model:  I)  Screening  by  GAP  triage  is  not  necessary  for  new  clients;  2)  The  UM 
unit  of  the  GAP  has  no  involvement  in  utilization  decisions  made  by  GAP  clinicians  or  other  LMHA 
clinicians.  Though  the  inpatient  prior  authorization  model  is  rigorous,  it  is  separate  from  utilization 
management. 
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C.  New  Haven 

Of  all  the  nine  sites  GAP  sites,  New  Haven  is  the  most  atypical.  The  largest  local 
community  heath  center  in  the  city,  Hill  Health  Center  (HHC),  has  served  as  the  fiscal 
and  administrative  manager  for  the  New  Haven  GA  Medical  program  for  many  years, 
and  primarily  due  to  their  close  collaboration  and  working  relationship  with  the  New 
Haven  LMHA,  New  Haven  GA  mental  health  costs  were  much  lower  than  in  other  cities. 
However,  the  city  still  thought  it  could  reduce  expenditures  and  improve  chances  for 
clients  becoming  employable  with  a  more  comprehensive  case  management  system.  In 
response  to  the  GAP  initiative,  New  Haven  LMHA  and  HHC  worked  closely  together, 
and  with  help  from  City  Welfare,  created  the  New  Haven  GA  Pilot.  Since  this  is  a 
collaboration  of  three  agencies  and  not  two,  and  on  a  lesser  scale  (their  annual  budget  in 
FY  95  was  $0.75  million),  their  organization  is  somewhat  different. 

Two  to  four  LMHA  caseworkers  are  usually  on  site  at  permanent  office  space  in 
city  welfare  to  provide  assessment,  treatment  planning,  and  limited  service  coordination 
for  GA  clients.  They  work  full  time  for  the  LMHA  and  spend  at  least  a  few  hours  a  week 
at  their  home  LMHA  divisions.  Hill  Health  Center  hired  a  utilization  management  nurse 
and  an  administrative  assistant,  who  are  also  based  in  the  New  Haven  City  welfare  office. 

The  LMHA  GAP  staff  are  actually  employees  of  several  divisions  of  the  New 
Haven  LMHA,  and  do  not  comprise  their  own  unit,  as  do  the  other  GAP  sites.  They  send 
clients  back  to  the  LMHA  for  much  of  the  brief  treatment,  entitlements,  and  vocational 
services,  that  other  sites  conduct  directly  with  GAP  staff. 

The  GAP  is  managed  jointly  through  an  Executive  Committee,  comprised  of  the 
city  GA  director,  the  HHC  GA  division  head  and  LMHA  Assistant  Director.  Most 
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decisions  are  made  by  a  Steering  committee,  which  is  open  to  any  staff  member,  though 
it  meetings  are  primarily  attend  by  LMHA  employees. 

1)  New  Haven  Intake 

The  GA  intake  and  GA  eligibility  determination  process  is  conducted  by  a  city 

intake  worker.  The  intake  screen  for  GA  benefits  takes  40-45  minutes  to  determine 
eligibility,  eligibility  category,  and  what  services  a  client  may  need.  After  intake,  the 
client  is  transferred  to  a  GA  caseworker.  The  coverage  caseload  in  New  Haven  at 
December  1995  was  212  clients  per  GA  caseworker,  and  the  total  caseload  had  doubled 
in  the  previous  five  years.  Current  standards  for  caseworkers  require  a  bachelors  degree 
in  a  social  science  field,  though  most  of  the  staff  has  been  working  since  before  these 
standards  took  effect,  and  do  not  have  a  college  education. 

Clients  are  usually  (though  not  always)  asked  if  they  have  a  substance  abuse 
problem  by  the  GA  caseworker.  The  GAP  created  a  substance  abuse  checklist  for  city 
caseworkers  to  use  during  intake,  but  it  was  not  used  because  GA  staff  felt  it  was  too 
time  consuming.  The  substance  abuse  screening  methods  employed  by  city  caseworkers 
is  basically  to  ask  'do  you  have  a  drug  problem?',  or  to  see  if  a  client  appears  obviously 
intoxicated  during  intake. 

If  the  client  is  thought  to  need  substance  abuse  services,  or  if  the  client  volunteers 
this  information,  the  caseworker  may  refer  the  client  to  one  of  the  GAP  workers 
collocated  at  the  city  welfare  office.  Alternatively,  already  enrolled  GA  clients  may  seek 
services  through  several  triage  gates. 

In  addition  to  City  Welfare,  triage  gates  are  located  at:  Southern  Connecticut 
Rehabilitation  Center  (an  inpatient  substance  abuse  detoxification  center);  SATU  (an 
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outpatient  substance  abuse  clinic,  and  satellite  clinic  of  the  New  Haven  LMHA);  the  city 
run  Needle  Exchange  program;  a  drug  court;  and  the  HHC  and  New  Haven  LMHA 
themselves.  Triage  gate  staff  have  received  training  in  GAP  procedures  and  some  of 
their  clinical  forms. 

Once  part  of  the  GAP  system,  the  client  meets  with  GAP  staff  to  create  a 
treatment  plan.  Unlike  Bridgeport  and  Hartford,  the  New  Haven  GAP  staff  do  not 
directly  provide  their  own  clinical  services.  Rather,  the  New  Haven  GAP  refers  clients 
back  to  its  LMHA  for  brief  treatment. 

2)  New  Haven  Utilization  Controls 

The  list  of  triage  gates  that  can  make  referrals  is  so  large  as  to  make  coordinated 

case  management  difficult.  The  GAP  utilization  management  staff  conducts  a 
concurrent  review  that  verifies  GA  eligibility  status  and  appropriateness  of  treatment. 
Utilization  management  may  also  modify  authorization  conditions.  At  end  of  the 
treatment  episode,  utilization  management  enters  full  information  on  treatment  for  billing 
purposes,  and  further  oversees  discharge  planning. 

Referrals  from  triage  to  network  providers  are  negotiated  with  GAP  utilization 
management  and  the  triage  gate.  The  client  is  then  sent  to  the  provider,  but  the  provider 
must  call  GAP  utilization  management  for  an  authorization  number,  even  though  the 
referral  has  been  already  been  approved  by  the  GAP.  This  policy  was  instituted  so 
providers  would  remain  in  close  contact  with  utilization  management  for  all  GAP  clients. 

The  GAP  generally  does  not  have  formal  letters  of  agreement  with  area  providers. 
Clients  are  referred  to  any  area  provider  who  offers  a  service  at  a  reasonable  cost.  There 
have  been  some  formal  agreements  with  some  providers  to  negotiate  lower  rates. 
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Appeals  of  utilization  management  decisions  are  made  to  the  Administrator  of  the  HHC 
managed  care  program.  There  have  been  some  complaints  on  quality  of  services,  and 
these  problems  were  solved  by  negotiation  with  the  HHC  managed  care  director.  As  of 
January  1996,  only  one  provider  is  no  longer  referred  clients  because  their  cost/ 
utilization  profile  remained  too  high  even  after  considerable  effort  was  spent  to  work  out 
a  reasonable  arrangement. 

The  following  flowchart  describes  the  New  Haven  GAP's  more  active  centralized 
utilization  management. 
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Figure  3-5:  New  Haven  GAP  client  flowchart 
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Of  the  three  sites,  only  the  New  Haven  GAP  gives  utilization  management  control 
over  all  types  of  care  and  referral  sources.  This  flowchart  simplifies  GA  triage  gates  into 
one  pathway,  though  there  are  several.  The  parallel  lines  between  a  box  labeled 
'Utilization  Management  and  Triage',  indicate  that  utilization  management  oversight  for 
referrals  from  Triage  gates  gives  utilization  management  power  in  care  assignments,  but 
Triage  gates  are  the  clinical  authority  for  GA  clients  when  making  decisions  about  mental 
health  or  substance  abuse  treatment.  Since  utilization  management  and  triage  at  City 
welfare  share  the  same  office  space,  their  negotiation  process  is  less  formal  than  remote 
triage  gates,  and  they  may  received  less  scrutiny  from  UM.  Figure  3-5  also  indicates  that 
clients  new  to  the  GAP  need  to  be  screened  by  a  triage  gate  if  clinical  status  permits. 

3.  Cross  site  comparisons 

There  are  several  differences  in  the  style  of  managed  care  between  the  GAP  sites, 
which,  in  light  of  the  review  of  the  organizational  literature,  suggest  several  questions  for 
study.  The  following  table  summarizes  clinical  and  managed  care  differences  in  the  three 
GAP  models. 
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Table  3-1:  Summary  of  GAP  site  differences 


|  Site 

Utilization  Controls 

Screening/Triage 

i 

GAP  Treatment 
Services 

Baseline 

-  None 

-    Informal  by  GA 
caseworker — may 
have  led  to  a 
mandatory  referral 

-  Cursory 
supervision 
offered  by  GA 
caseworker.  No 
professional 
service 
coordination 

Bridgeport 

-  Gatekeeping 
model  for  mental 
health  and 
substance  abuse 
outpatient  services 

-  Prior  authorization 
for  inpatient  stays 

-    All  new  non- 
emergency cases 
must  be  screened 
by  GAP 

-  Most  intensive  of 
all  the  case 
management 
models 

-  Brief  Treatment 
Unit  (started 
4/95)  runs  groups 
and  individual 
therapy—serves  as 
an  anchor  to 
engage  and 
monitor  clients 

Hartford 

-  No  substance 
abuse 

responsibilities. 

-  UM  for  outpatient 
providers  only. 

-  Prior  authorization 
for  inpatient 
psychiatric 

llUopiLdllZuLlUIlo" 

sometimes  not  by 
GAP  staff. 

-  No  formal  review 
of  parent  LMHA 
services. 

-    GAP  Screening  for 
new  clients  is  not 
necessary  before 
starting  treatment. 

Service 
coordination 
-    Some  groups  and 
individual  therapy 
through  GAP 
Brief  Treatment. 

New  Haven 

-    UM  for  mental 
health  and 
substance  abuse 
services 

-    New  clients  must 
be  screened  by  one 
of  several  'Triage 
Gates'. 

Limited  Service 
Coordination 

This  table  highlights  key  differences  in  intake,  utilization  and  treatment  services  of  the  three  cases  and 
their  baseline  state. 
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The  most  striking  differences  between  sites  is  that  Hartford  manages  mental 
health  care  only,  and  its  utilization  management  is  only  for  services  provided  by  outside 
(non-LMHA)  providers.  The  Bridgeport  and  New  Haven  GAPs  both  cover  mental  health 
and  substance  abuse  care,  though  the  Bridgeport  GAP  does  this  through  a  highly 
centralized  intake  and  screening  process  and  a  gatekeeper  model  to  outside  care.  New 
Haven  has  several  official  screening  and  referral  locations,  but  one  centralized  utilization 
management  facility  that  oversees  all  behavioral  health  treatment. 

A.  Organizational  research  questions 

The  variation  between  the  three  cases  allows  limited  exploration  of  how  multiple 

service  agencies  can  effectively  integrate  their  services.  Chapter  2  presented  four  aspects 
of  organizational  research  that  can  lend  insight  into  the  GAP. 

First,  interagency  collaborations  are  thought  to  foster  tension  between  different 
agency  staff,  and  I  have  speculated  that  inter-disciplinary  differences  may  exacerbate 
these  tensions  further.  Second,  joint  management  and  collocation  are  intended  to  ease 
these  tensions  and  improve  information  flow  between  agencies.  Third,  more 
individualistic  mechanisms,  like  personal  relationships  between  agency  leaders  and  the 
extent  of  participatory  management,  may  also  smooth  the  running  of  interagency 
collaborations.  All  three  of  these  issues  will  be  qualitatively  explored  in  Chapter  5 
through  archival  review,  site  visits,  and  key  informant  interviews.  Fourth,  the  ultimate 
theoretical  organizational  impact  is  that  integration  strategies  directly  affect  a  client's  use 
of  services.  This  issue  will  be  explored  by  combining  qualitative  and  quantitative 
evidence  in  Chapter  7. 
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B.  Inter-site  variation  and  managed  care  outcomes 

Differences  in  the  organization  of  these  three  sites  (as  listed  in  the  table  on  Inter- 
site  differences)  also  suggest  potential  differences  in  the  hypotheses  listed  in  the  previous 
section.  All  three  sites  differ  in  screening,  utilization  management,  and  service 
coordination,  and  these  factors  are  likely  to  directly  influence  the  access  and  utilization. 

Access  to  any  care  is  influenced  by  the  number  and  convenience  of  entry  portals. 
Making  screening  easier  to  receive  does  increase  access  to  any  care,  though  clients  may 
still  receive  care  without  a  prior  screening. 

Bridgeport  requires  screening  before  any  behavioral  health  treatment,  and  such 
screenings  can  only  be  done  at  the  welfare  collocation  site  and  the  GAP  satellite  office 
(they  do  have  limited  mobile  capacity  for  emergency  screenings).  The  Bridgeport  GAP 
has  added  some  portals  of  entry  especially  designed  for  their  accessibility  (e.g.  the 
collocation  site)  but  has  also  minimized  the  role  of  all  providers  as  access  portals.  It 
remains  to  be  seen  if  the  Bridgeport  access  model  serves  as  a  bottle  neck  or  improvement 
to  access.  Unfortunately,  DMHAS  withdrew  their  permission  for  analysis  of  all 
Bridgeport  electronic  records,  so  this  information  can  only  be  explored  qualitatively. 

In  contrast,  New  Haven  requires  screening,  but  as  multiple  provider-based  triage 
gates,  and  so  should  be  able  to  increase  access  compared  to  Bridgeport.  The  most 
extreme  case  is  Hartford,  which  adds  to  the  total  number  of  access  portals  with  its 
collocation  site,  but  does  not  close  off  any  others  by  not  requiring  screening  before  most 
forms  of  behavioral  health  treatment.  By  this  logic,  Hartford  should  have  even  higher 
rates  of  access  than  New  Haven. 

Utilization  management  and  service  coordination  work  together  to  change 
utilization,  but  not  in  the  same  way,  or  even  for  the  same  reasons.  Utilization 
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management  tends  to  limit  utilization  and  manipulate  substitution  from  a  cost 
perspective.  Service  coordination  also  encourages  substitution,  but  from  a  clinical  and 
quality  enhancing  perspective.  I  speculate  that  the  difference  in  strength  of  these  two 
motives  may  lead  to  different  decisions  about  care. 

New  Haven  has  the  strongest  Utilization  Management  program  of  all  these  sites, 
and  the  least  intensive  service  coordination.  This  combination  may  lead  to  over 
substitution.  In  contrast,  Bridgeport  has  very  weak  Utilization  Management  and  the 
strongest  service  coordination,  and  this  combination  may  lead  to  more  intensive,  though 
clinically  sound,  care  patterns.  Hartford  has  a  moderate  to  weak  Utilization 
Management  model  and  a  moderate  to  strong  service  coordination  system,  but  is  severely 
limited  in  scope  by  its  failure  to  fully  address  substance  abuse  clients  or  substance  abuse 
services  for  clients  with  serious  mental  illness.  It  will  be  interesting  to  see  if  a  smaller 
scale  model  is  sufficient  to  impact  utilization  patterns  in  any  meaningful  way. 

4.  Conclusion 

This  chapter  has  highlighted  the  complexity  and  diversity  in  the  GAP  programs. 
While  these  operational  details  may  prove  interesting  to  behavioral  health  and  welfare 
professionals  in  their  own  right,  the  three  GAP  examples  can  be  used  to  explore  managed 
care  and  services  integration  in  a  broader  sense.  The  next  chapter  will  suggest  ways  in 
which  to  do  so. 
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Chapter  4:  Methods 


This  chapter  operationalizes  the  evaluation  principles  described  in  the  Literature 
Review,  and  applies  them  to  the  GAP  sites  through  two  primary  methods.  First  is  a 
qualitative  organizational  study  relying  on  analysis  of  key  informant  interviews  and 
archives  that  describes  how  the  GAP  sites  integrate  services  and  manage  care.  Second 
are  quantitative  analyses  of  several  administrative  data  sets  exploring  if  the  GAPs 
changed  access  to  care  or  utilization  patterns.  After  a  brief  discussion  of  data  collection 
methods,  each  of  these  topics  will  be  explored  in  greater  detail. 

1.  Participant  Observation 

Evaluating  the  General  Assistance  Pilot  Project  (GAP)  at  this  level  of  detail 
would  probably  not  be  possible  if  I  were  not  an  employee  of  the  Department  of  Mental 
Health  and  Addiction  Services  while  conducting  this  study.  My  experience  with 
DMHAS  gives  me  a  richer  background  of  information  to  draw  from  than  the  formal  data 
collection  associated  with  this  dissertation  would  by  itself.  However,  my  official 
responsibilities  were  only  peripherally  related  to  the  GAP,  and  I  do  not  completely  fit  the 
definition  of  the  traditional  'participant  observer'  role  of  a  researcher  (Yin,  1994).  I  will 
briefly  explain  what  my  experiences  were  since  they  do  affect  the  available  information 
and  my  interpretations  of  them. 

I  worked  for  DMHAS  part  time  from  May  1993  to  March  1998  in  several 
positions,  and  for  some  of  this  time,  the  GAP  evaluation  was  part  of  my  recognized 
responsibilities.  As  an  intern  at  the  Central  Office,  I  conducted  qualitative  and 
quantitative  explorations  of  DMHAS  service  delivery,  and  in  the  course  of  those  projects 
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became  very  familiar  with  DMHAS  facilities  and  information  systems,  and  met  with 
several  of  the  people  that  I  later  interviewed  during  this  study.  Until  1996, 1  also  helped 
prepare  periodic  reports  to  the  Legislature  on  a  variety  of  special  projects,  including  the 
GAP.  In  1994, 1  worked  as  the  evaluation  coordinator  for  the  ACCESS  demonstration 
project  at  the  Bridgeport  LMHA,  which  was  my  first  experience  working  directly  for  a 
DMHAS  provider  agency.  In  October  1996  (just  after  this  study's  follow-up  period 
ended),  I  permanently  transferred  my  position  from  Central  Office  to  the  New  Haven 
LMHA  to  work  with  their  new  Office  of  Managed  Care  that  oversaw  the  expansion  of  the 
New  Haven  GAP  beyond  its  pilot  phase.  There  I  attended  statewide  DMHAS/GA 
coordinators  meetings,  served  on  work  groups  on  reporting  and  information  management, 
and  worked  closely  with  some  of  the  New  Haven  GAP  staff. 

These  experiences  have  given  me  a  rich  informal  foundation  upon  which  to  build 
formal  data  collection  and  analysis.  Starting  with  qualitative  and  organizational  analyses, 
these  more  formal  methods  are  described  below. 

2.  Qualitative  data  collection  and  hypotheses 

Similar  to  the  Robert  Wood  Johnson  Program  on  Chronic  Mental  Illness 
(Goldman,  Lehman,  Morrissey,  Newman,  Frank  &  Steinwachs,  1990),  this  dissertation  is 
essentially  three  case  studies  that  implement  the  same  program  in  three  distinct,  yet 
similar,  service  systems.  Unlike  the  Robert  Wood  Johnson  program,  the  GAP  lacks  the 
careful  attempts  to  implement  the  intervention  consistently  (and  even  the  RWJ 
intervention  varied  considerably  across  its  nine  sites).  More  importantly,  the  GAP  lacks 
detailed  formal  documentation  of  its  goals,  implementation,  and  activities. 


88 


I  spent  some  time  searching  through  the  files  of  the  Planning  Director  and  the 
Deputy  Commissioner  of  Operations  for  documents  on  the  genesis,  mission,  and  design 
of  the  GAP.  This  search  was  not  very  useful — DMHAS  (probably  like  most  state 
agencies)  conducts  most  of  its  planning  during  informal,  un-transcribed  face  to  face 
meetings,  and  rarely  develops  'white  paper'  style  written  proposals  for  internal  use.  The 
monthly  legislative  reports  I  helped  compile  included  one  paragraph  on  each  GAP  site's 
activities  that  usually  said  the  same  thing  for  months  at  a  time.  I  also  saw  of  much  of  the 
LMHA  directors'  correspondence  to  Central  Office  regarding  the  implementation  of  the 
GAP,  and  it  was  similarly  vague. 

A.  Data  sources  and  methods 

Personal  communication  proved  far  more  informative.  I  gained  a  general 

understanding  of  the  GAP  as  a  state  wide  process  through  informal  conversations  with 
the  Planning  Director,  Assistant  Director  for  the  Central  District,  and  the  two  DMHAS 
Deputy  Commissioners,  and  through  my  formal  working  relationship  with  the  GAP 
statewide  coordinator.  To  get  a  true  operational  picture  of  the  GAP  sites,  I  relied  on  site 
visits,  semi-structured  interviews,  and  numerous  informal  fact  checking  phone  calls.  This 
information  gathering  process  also  fostered  exploration  of  some  organizational  questions 
developed  in  the  literature  review,  which  are  also  described  below. 

To  gain  a  working  understanding  of  General  Assistance,  I  informally  questioned 
staff  at  DSS's  Office  of  General  Assistance,  whom  I  became  familiar  with  while 
negotiating  data  transfers  between  our  two  agencies.  I  also  obtained  DSS's  General 
Assistance  Manuals.  To  get  a  better  idea  of  the  GA  intake  and  benefits  assignments 
process,  in  the  summer  of  1996  I  attended  DSS  full-day  training  on  these  subjects  for 
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city  GA  caseworkers.  I  finally  was  able  to  flesh  out  the  necessary  details  of  this 
confusing  bureaucracy  through  interviews  and  informal  conversations  with  GA 
Caseworker  supervisors. 

In  January  1995, 1  spent  one  day  touring  each  of  the  collocation  facilities,  city 
welfare  facilities,  and  in  the  case  of  Hartford,  LMHA  office  space,  for  the  three  GAP 
sites  under  study.  These  informal  visits  provided  the  chance  to  chat  with  GAP  directors 
about  what  they  thought  the  key  goals  and  features  of  the  program  were,  and  meet  GAP 
clinical  staff  and  learn  about  work  flow  and  the  smoothness  of  the  implementation 
process.  It  also  gave  me  the  chance  to  form  relationships  with  GAP  personnel  at  each 
site  that  facilitated  more  formal  interviewing  a  year  later.  Further,  this  process  helped 
steer  the  review  of  the  organizational  literature,  which  in  turn  helped  facilitate  questions 
for  the  semi-structured  interviews. 

B.  Organizational  Analyses 

The  organizational  findings  of  this  dissertation  (in  Chapter  5)  does  not  involve 

formal  hypothesis  testing,  but  rather  explores  certain  organizational  themes  that  became 
apparent  through  the  initial  site  visits,  the  literature  review,  and  the  complicated  design  of 
the  GAP.  All  of  these  questions  address  how  these  GAP  sites  are  able  to  function,  and 
what  will  make  some  sites  function  better  than  others.  More  specifically,  they  deal  with 
the  effectiveness  of  collocation  as  a  services  integration  strategy,  and  the  ability  of  public 
sector  staff  to  manage  care.  The  formal  research  questions  to  be  addressed  through 
qualitative  data  collection  are: 
1.  How  do  the  GAPs  function? 
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Special  focus  was  placed  on  identifying  client  flow  and  managed  care 
mechanisms.  For  example,  charts  of  client  flow  were  reviewed  with  key  staff. 

2.  What  problems  did  the  GAPs  encounter,  and  are  these  problems  products  of  their 
design? 

Two  sorts  of  tensions  are  hypothesized  to  occur: 

-  Forcing  mental  health  LMHA  staff  to  work  with  less  disabled  GA  recipients  assumed 
to  have  more  substance  abuse  needs  would  lead  to  treatment  discipline  conflicts 
within  the  GAP,  and  the  GAP  and  its  parent  LMHA. 

-  Differing  professional  models  and  resource  pressures  would  lead  to  tensions  between 
GAP  staff  and  G A  staff. 

3 .  How  did  the  GAPs  seek  to  overcome  these  problems? 

From  the  site  visits  and  literature  review,  two  factors  are  predicted  to  minimize 
these  tensions: 

-  The  management  techniques  of  joint  management  and  joint  training,  as  well  as 
personal  relationship  between  managers,  will  minimize  conflicts. 

-  Collocation  will  allow  GA  staff  and  GAP  staff  to  work  together  more  efficiently  and 
harmoniously. 

C.  Key  Informant  Interviews 

To  formally  address  these  issues,  I  planned  to  interview  the  GAP  Project  Director, 

GAP  Clinical  Director,  GAP  Utilization  Coordinator,  and  City  GA  Director.  In  piloting 
these  interviews,  I  found  City  GA  Directors'  responsibilities  were  much  more 
administrative,  and  they  had  little  knowledge  of  line  staff  procedures,  so  I  added  a  GA 
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caseworker  supervisor  to  the  subject  pool.  Further,  the  subject  selection  protocol  had  to 
be  modified  at  each  site  due  to  implementation  differences. 

The  subjects  actually  interviewed,  and  the  dates  of  those  interviews  are  listed  in 
Table  4-1.  Though  anonymity  was  explicitly  not  guaranteed  to  interviewees,  staff  names 
will  not  be  used,  and  opinions  and  direct  quotes  of  interviewees  will  not  be  attributed  to 
individuals  where  possible. 

Table  4-1:  Listing  of  Interviewees  Job  Titles  by  GAP  Site 


Site 

Bridgeport 

Hartford 

New  Haven 

Date 

Informants  to  be 

March  1996 
Informants  Interviewed 

February  1996 

January  1996 

Interviewed 

Informants  Interviewed 

Informants  Interviewed 

GAP  Project 
Director 

Project  Director 

Project  Director 

Multi-Agency  Initiative: 

Interviewed 
both  the  LMHA 
Associate  Director  and 
Health  Center's  Director 
of  Managed  Care 

GAP  Clinical 
Director 

Clinical  Director 

Clinical  Director 

No  such  title  - 
interviewed  the  clinical 
supervisor  of  many  of 
the  LMHA  GAP 
clinicians 

GAP  Utilization 

Review 

Coordinator 

No  comparable 
position — Clinical 
Director  was  asked  these 
questions 

Utilization  Review 
Coordinator 

Utilization  Review 
Coordinator 

City  GA  Director 

City  GA  Director 

City  GA  Director 

City  GA  Director 

City  GA 

Caseworker 

Supervisor 

The  City  GA  Director 
was  promoted  from 
Assistant  Director 
position  2  months  prior 
to  interview  and  directly 
supervised  GA 
Caseworkers 

GA  Caseworker 
Supervisor 

Assistant  GA  Director — 
directly  supervised  GA 
Caseworkers. 

These  interviews  are  semi-structured  and  were  piloted  through  a  site  visit  and  four 
interviews  at  the  Norwich  GAP.  A  listing  of  questions  and  goals  per  subject's  role  are 
shown  in  Table  4-2.  A  careful  reader  will  note  that  many  subjects  are  asked  the  same 
questions,  or  asked  to  confirm  the  same  information.  Because  of  the  lack  of  formal 
documentation,  I  suspected  that  GAP  staff  may  perform  their  functions  differently  than 
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other  people  in  their  units  thought  they  did.  This  turned  out  not  to  be  true,  and  the 
descriptions  of  programmatic  activity  were  very  similar,  though  the  nuance  and 
interpretation  of  the  activity  was  not  always  as  consistent. 


Table  4-2:  Listing  of  interviewer  prompts  and  goals  for  semi-structured  Key 
Informant  interviews 


Goals  and  Questions  for  Project  Director  Interview 

Obtain  a  Provider  Network  description 

Size  and  growth 
Obtain  information  on  Staffing  Patterns  (and  changes  over  time) 

for  Welfare  Offices 

For  Pilot  sites 
Provider  Management 

What  criteria  did  you  use  to  select  network  providers? 

How  do  you  review  network  provider's  performance? 

Have  you  ever  removed  a  provider  from  the  network,  and  why? 

What  are  the  quality  control  standards  for  your  own  clinicians? 

Do  you  do  any  sort  of  provider  profiling? 

Do  you  more  carefully  review  decisions  by  'problem'  providers? 

How  do  you  teach  providers  acceptable  care  practices  ? 

What  information  do  you  collect  to  monitor  the  quality  of  your  own  programs? 
Obtain  information  on  mechanisms  for  coordination  of  care 

Extent  of  co-location 

types  of  meetings 

nature  and  extent  of  informal  information  sharing 
for  City  and  Pilot 
for  LMHA  and  pilot 

for  RACs  (local  substance  abuse  authorities)  and  pilots 

Other  information 

Has  the  Pilot  been  fully  implemented? 

Has  the  Pilot  met  any  resistance?  How  has  this  been  dealt  with? 

Have  any  unforeseen  problems  emerged? 

How  successful  would  you  say  the  program  has  been? 

Any  obstacles  remaining? 

How  is  the  pilot  perceived  by  the  city  welfare,  LNfHA 

Do  you  think  the  Pilot  should  be  extended  to  other  sites  (why  or  why  not) 

Goals  and  Questions  for  City  GA  Director  and  GA  Casework  Supervisor 

(Each  person  asked  the  same  questions  separately) 
Obtain  a  Welfare  Services  Inventory 

change  in  services  over  time 
How  receptive  are  eligible  clients  to  the  Pilot? 
How  do  participants  differ  form  non-participants? 

Review  client  flow  charts  (including  changes  over  time,  and  location  of  services) 

Client  path  through  GA  prior  to  Pilot 

Path  through  GA  after  Pilot 

GA  referral  process  to  Pilot 
Obtain  information  on  Staffing  Patterns  (and  changes  over  time) 

for  Welfare  Offices 
Other  information  needed 

Has  the  Pilot  been  fully  implemented? 

Has  the  Pilot  met  any  resistance?  How  has  this  been  dealt  with? 

Have  any  unforeseen  problems  emerged? 

How  successful  would  you  say  the  program  has  been? 

Any  obstacles  remaining? 

How  is  the  pilot  perceived  by  the  city  welfare,  LMHA? 

Do  you  think  the  Pilot  should  be  extended  to  other  sites  (why  or  why  not) 
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Goals  and  Questions  for  the  Utilization  Review  Coordinator 

Managed  care  processes  since  implementation 

What  do  you  require  before  you  approve  a  service? 

Who  conducts  the  initial  client  assessment  in  which  a  service  can  be  authorized? 
Who  confirms  it? 

Approximately  how  often  are  initial  recommendations  negotiated  with  providers  (approved  with 
modifications)? 

Who  does  the  negotiations? 

Who  typically  conducts  the  first  review  in  which  an  admission/utilization  can  be  denied? 

How  often  does  this  occur? 

Is  there  a  formal  appeals  process? 

How  often  is  it  used? 

how  often  are  decisions  overturned! 

How  important  are  the  following  when  approving  an  inpatient  service? 
UR  coordinator  and  written  protocol 
severity  of  current  symptoms 
adamancy  of  treating  clinician 
threat  of  suicide 
client  anxious  or  upset 
social  isolation 
dangerous  living  conditions 
homelessness 

history  of  treatment  non-compliance 
geography/travel  complications 
scheduling  complications 
other  (list) 

Utilization  Review  Criteria 

Do  you  use  formal  written  criteria  for  admission  into  any  type  of  service? 

How  were  these  criteria  developed? 

When  and  why  will  you  disclose  these  criteria  to  providers? 

What  factors  coulaVhave  change(d)  these  criteria? 

What  information  do  you  collect  to  monitor  the  quality  of  your  own  programs? 

Mechanisms  for  coordination  of  care 
Extent  of  co-location 
types  of  meetings 

nature  and  extent  of  informal  information  sharing 
for  City  and  Pilot 
for  LMHA  and  pilot 

for  RACs  (local  substance  abuse  authorities)  and  pilots 

Other  information  needed 

Has  the  Pilot  met  any  resistance?  How  has  this  been  dealt  with? 

Have  any  unforeseen  problems  emerged? 

How  successful  would  you  say  the  program  has  been? 

Any  obstacles  remaining? 

How  is  the  pilot  perceived  by  the  city  welfare,  LMHA? 

Do  you  think  the  Pilot  should  be  extended  to  other  sites  (why  or  why  not)? 


Goals  and  Questions  for  Clinical  Director 

Ask  for  and  confirm  draft  flow  charts  (including  changes  over  time,  and  location  of  services) 
Client  Path  through  Pilot 
Estimates  of  wait  times 

Other  information  needed  to  know 

Has  the  Pilot  been  fully  implemented? 

Has  the  Pilot  met  any  resistance?  How  has  this  been  dealt  with? 

Have  any  unforeseen  problems  emerged? 

How  successful  would  you  say  the  program  has  been? 

Any  obstacles  remaining? 

How  is  the  pilot  perceived  by  the  city  welfare,  LMHA? 

Do  you  think  the  Pilot  will  be  extended  to  other  sites  (why  or  why  not)? 


The  interviews  lasted  from  about  V2  an  hour  to  a  little  over  an  hour.  I  personally 
conducted  all  interviews,  tape-recorded  them,  and  used  the  recordings  to  supplement  my 
notes  during  transcription.  One  subject  I  deliberately  did  not  tape  record,  as  when  I  had 
interviewed  her  two  years  prior  for  an  unrelated  study,  she  became  emotional  and  I  did 
not  want  to  make  her  nervous.  During  interview  with  another  informant,  I  stopped 
recording  halfway  through  when  she  became  upset.  I  was  careful  to  take  more  thorough 
notes  in  these  cases  and  completed  all  of  the  interviews. 

All  interviews  were  conducted  one  on  one  and  in  private,  with  the  exception  of  a 
joint  interview  with  the  Bridgeport  GA  Director  and  Clinical  Director.  I  explicitly  asked 
them  the  same  questions  again  when  they  were  alone  if  it  seemed  their  responses  were 
constrained  by  the  presence  of  the  other. 

The  interview  data  are  supplemented  with  information  from  various  memoranda, 
and  reports  obtained  from  staff  at  the  GAP  sites,  the  GAP  Statewide  Coordinator,  and  the 
General  Assistance  Policy  manual,  as  well  as  direct  observations  made  in  my  capacity 
a  research  assistant  at  DMHAS  central  office.  Further,  all  subjects  have  been  very 
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generous  with  their  time  in  answering  follow-up  questions  in  person  or  on  the  telephone, 
and  in  recommending  other  people  for  me  to  talk  to  about  more  specific  questions. 

D.  Limitations 

Qualitative  data  analysis  has  two  key  limits.  First,  this  case  study  approach  can 
only,  at  best,  suggest  hypotheses  on  how  other  organizations  may  behave  under  similar 
circumstances,  or  make  counter-factual  claims  to  disprove  existing  theories.  There  are 
too  many  uncontrolled  aspects  of  the  GAP  implementations  and  too  much  unknown 
information  about  these  service  systems  they  reside  in  to  make  more  definitive  claims. 
Second,  gathering  and  analyzing  qualitative  data  is  an  inherently  subjective  process,  and 
two  areas  may  cause  particular  concern  in  this  evaluation. 

First,  as  Yin  (1994)  cautions,  participant  observation  can  bias  analyses  because 
the  researcher  has  an  inherent  interest  in  seeing  a  project  evaluated  successfully.  This  is 
less  likely  to  occur  for  me  because  I  had  no  operational  influence  over  the  GAP.  In  some 
aspects,  I  am  not  a  participant  observer,  as  I  never  fully  participated  in  the  operations  of 
the  program. 

Another  concern  stems  from  heavy  usage  of  informal  conversations  to  guide  more 
formal  data  collection.  However,  given  the  lack  of  rigorous  documentation  from 
DMHAS,  it  was  the  most  efficient  way  to  collect  enough  operational  detail  on  the 
programs  to  understand  them.  The  brief  program  description  section  in  the  Introduction 
of  this  dissertation  is  the  most  detailed  written  description  of  the  GAP  I  have  seen.  I 
deliberately  relied  on  multiple  informants  in  different  positions  to  minimize  the  risk  that  I 
would  be  too  heavily  influenced  by  any  one  person's  perspective. 
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Interestingly,  I  noticed  the  higher  up  on  the  organizational  ladder  a  key  informant 
was,  the  more  likely  they  were  to  speak  in  glowing  generalities  (though  Central  Office 
managers  were  not  as  interested  in  impressing  me).  I  discounted  such  statements  heavily 
unless  they  could  point  out  specific  examples  to  illustrate  their  points.  I  also  found  that 
reading  explanations  of  the  study  purpose  and  confidentiality  limits  to  the  key 
informants,  as  required  by  the  Yale  Human  Investigations  Committee,  calmed  their 
concerns  about  me  being  a  'Central  Office  spy',  and  seemed  to  lead  to  candid  interviews. 
Finally,  I  did  use  standard  interviewing  techniques,  such  as  active  listening,  or  anchoring 
events  in  time  by  pointing  to  a  calendar  or  mentioning  other  contemporaneous  events 
when  asking  informants  to  recall  information  (I  even  did  this  outside  of  the  formal 
interviews,  when  socially  appropriate). 

Most  importantly,  I  relied  on  written  documentation  and  information  systems  to 
confirm  dates  of  major  policy  shifts  highlighted  to  me  by  Key  Informants.  For  example, 
I  asked  a  Central  Office  contact  when  DMHAS  began  its  prior  authorization  program  for 
all  mental  health  inpatient  admissions,  and  was  told  that  it  began  in  December  1992.  I 
looked  up  the  activity  of  these  authorization  units  on  DMHAS  utilization  database,  and 
found  they  had  reported  only  sporadic  activity  until  January  1993  at  the  New  Haven 
LMHA,  and  March  1993  at  the  Hartford  LMHA.  I  used  this  technique  of  confirming 
information  with  multiple  types  of  sources  whenever  possible. 

Much  of  the  results  of  this  data  collection  has  already  been  presented  in  the 
Program  Description  and  Literature  Review  Chapters.  Exploration  of  the  organizational 
questions  follows  in  Chapter  6. 
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3.  Quantitative  data  collection  and  hypotheses 

This  dissertation  is  primarily  concerned  with  evaluating  how  the  GAP  sites  of 
Bridgeport,  New  Haven,  and  Hartford  affect  access  to  and  utilization  of  behavioral  health 
services.  More  specifically,  the  hypotheses  are  that:  1)  A  greater  proportion  of  GA 
enrollees  will  have  contact  with  behavioral  health  professionals;  and  2)  the  GAPs  will 
lower  behavioral  health  costs  per  client.  These  hypotheses  are  quantitatively  addressed 
through  linkage  and  analysis  of  General  Assistance  Rosters  and  DMHAS  utilization 
records.  The  process  of  obtaining  these  records,  and  their  linkage,  are  described  below. 

A.  Obtaining  the  data 

During  the  time  period  under  study,  the  Connecticut  Department  of  Social 

Services  (DSS)  set  polices  and  managed  (via  contractor)  medical  payment  for  general 
assistance,  while  Connecticut  towns  and  cites  administered  enrollment  and  cash 
disbursement.  Each  town  stored  its  own  roster  of  General  Assistance  enrollees  and 
eligibility  information  in  their  own  fashion.  Bridgeport,  Hartford,  and  New  Haven 
maintained  theirs  electronically,  though  in  different  formats.  Records  of  paid  GA 
medical  claims  (all  non-DMHAS  medical  services)  are  collected  and  stored  as  part  of  the 
state  Medicaid  system  by  a  DSS  contractor.  DMHAS  services  are  stored  in  their 
information  management  system.  Gaining  access  to  these  records  was  a  complicated 
political  and  technical  process  that  took  almost  two  years. 

Gaining  access  was  politically  complicated  given  the  number  of  agencies 
involved  and  their  use  of  contractors  to  actually  manage  the  data.  For  example,  getting 
permission  from  DSS  to  access  GA  claims  and  Rosters  took  six  months.  It  started  with  a 
letter  of  request  on  my  behalf  from  the  Commissioner  of  DMHAS  to  the  Commissioner 
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of  DSS.  From  there,  I  worked  out  the  confidentiality  details  in  a  series  of  meetings  with 
DSS  staff.  Gaining  possession  of  the  extracts  themselves  was  a  separate  and  highly 
technical  process  that  will  be  explained  in  the  next  section. 

The  sensitive  nature  of  claims  data  adds  another  layer  of  complexity  beyond 
interagency  cooperation  and  differing  data  standards.  A  good  example  of  these  problems 
was  my  difficulty  in  obtaining  the  New  Haven  GA  rosters.  In  response  to  a  request  for 
town  GA  Rosters  on  my  behalf  from  DSS's  Director  of  General  Assistance  and 
DMHAS's  GAP  Statewide  Coordinator,  Hartford  and  Bridgeport  agreed  readily,  but  New 
Haven  did  not.  It  took  several  weeks  of  phone  calls  to  find  out  why  New  Haven  had  not 
responded.  The  Director  for  New  Haven  Welfare  told  me  she  was  reluctant  to  comply 
because  she  had  already  refused  a  request  from  her  Mayor  to  give  similar  records  to  the 
local  police  department,  so  they  could  arrest  GA  recipients  with  outstanding  warrants 
when  they  went  to  the  GA  offices  to  pick  up  their  checks.  During  a  lengthy  conversation 
with  her,  I  carefully  explained  DMHAS's  role  in  the  project  and  the  restrictions  placed  on 
me  by  Yale's  Human  Investigations  committee  and  she  eventually  agreed. 

Each  non-DMHAS  data  set  was  collected  in  two  waves  one  year  apart.  Technical 
complexities  and  poor  documentation  made  obtaining  the  data  and  linking  it  problematic. 
The  GA  claims  files  had  records  from  HCFA  1500-  and  UB-92  billing  forms  but  the  files 
were  poorly  documented.  It  took  many  months  of  phone  calls  and  visits  to  DSS 
contractor,  DSS  staff,  the  Connecticut  Hospital  Association,  and  several  provider  billing 
departments  to  understand  the  file  structure  and  field  values  enough  to  identify  all  of  the 
behavioral  health  and  emergency  room  claims. 
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GA  Roster  files  had  similar  technical  complexities,  but  to  a  lesser  extent.  It 
proved  impossible  to  transmit  clear  instructions  to  the  programmers  in  each  city  through 
their  city  welfare  agencies.  After  initial  incorrect  data  submissions,  I  worked  closely 
with  each  programmer  to  obtain  reasonable  extracts,  and  in  the  case  of  Bridgeport,  ended 
up  seeking  and  obtaining  permission  to  download  the  data  myself.  After  consultation 
with  the  programmers  and  city  GA  caseworkers  from  each  site,  I  was  able  to  decode  the 
fields. 

Ironically,  internal  DMHAS  politics  turned  out  to  be  the  greatest  impediment  to 
data  access  and  linkage.  Not  all  DMHAS  managers  were  supportive  of  this  evaluation, 
and  I  had  periodic  difficulties  with  the  Directors  of  Quality  Assurance  and  Research 
throughout  the  data  collection  and  preparation  phases.  These  difficulties  made  it 
impossible  to  gain  access  to  GA  claims  records,  and  all  records  from  the  City  of 
Bridgeport.  Consequently,  the  quantitative  portion  of  the  evaluation  uses  the  New  Haven 
roster,  which  contained  all  GA  records  from  September  1,  1992  to  August  31,  1996,  but 
no  demographic  information,  and  the  Hartford  roster,  which  contained  all  GA  records 
from  April  1,  1992  to  August  31, 1996,  and  some  demographic  data. 

The  next  sets  of  usable  data  came  from  DMHAS  itself.  DMHAS  maintains 
comprehensive  electronic  records  on  all  the  people  it  provides  services  to.  Though  this 
system  came  online  in  the  early  1990s,  facilities  have  entered  many  care  episodes  as  far 
back  as  the  1970s.  I  had  been  working  with  this  information  system  in  other  capacities 
for  several  years,  and  had  permission  to  use  this  database  for  the  GAP  evaluation.  A 
separate  database  contains  records  on  all  substance  abuse  services  provided  by  licensed 
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substance  abuse  providers;  DMHAS  would  not  grant  permission  for  its  use  in  this 
evaluation. 

To  protect  client  confidentiality,  I  had  promised  DSS  that  all  files  would  be 
merged  on  the  DMHAS  computer  server.  To  accommodate  the  file  volume,  DMHAS 
purchased  additional  hard  disk  space,  paid  for  in  part  by  a  scholarship  I  obtained  from  the 
Yale  Urban  Health  Initiative. 

B.  Linking  the  data 

Both  the  Hartford  and  New  Haven  rosters  were  uploaded  onto  the  DMHAS 

computer  server  by  DMHAS  staff  (I  did  not  have  the  access  privileges  to  do  this),  where 
I  cleaned  them,  and  then  collapsed  them  into  episodes  of  enrollment  on  medical  benefits 
(where  GA  would  act  as  their  medical  insurance).  These  records  would  be  linked  with 
DMHAS  utilization  records,  stripped  of  identifying  information,  and  downloaded  to  a 
non-DMHAS  PC  for  analysis. 

This  linkage  process  proceeded  in  two  stages  for  both  Hartford  and  New  Haven. 
The  DMHAS  utilization  dataset  consists  of  many  different  records  linked  by  a  unique 
client  identifier.  GA  Rosters  also  had  many  records  per  client,  also  linked  by  a  separate 
unique  client  identifier,  to  note  each  action  in  their  GA  benefits  history  (e.g.  suspensions, 
benefits  changes,  caseworker  reassignments).  In  Hartford,  GA  Roster  records  were 
available  from  4/1/92  to  8/3 1/96  (for  a  total  of  1614  days  of  follow-up).  In  New  Haven, 
GA  Roster  records  were  available  from  8/3 1/92  to  8/3 1/96  for  a  total  of  1462  days  of 
follow-up.  Data  on  Sex,  Race,  and  Ethnicity  was  included  in  Hartford's  GA  Roster  but 
not  New  Haven's. 
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To  create  a  dataset  with  analytic  validity,  I  had  to  streamline  and  link  these  two  data  sets 
by  common  fields.  This  was  a  lengthy  and  complicated  procedure  that  is  described  in  the 
Appendix.  Only  a  summary  will  be  mentioned  below. 

First,  I  collapsed  the  GA  Roster  records  in  to  discrete  episodes  of  GA  medical 
benefits  coverage.  Data  from  the  record  indicating  the  start  of  GA  medical  benefits 
collapsed  into  data  from  the  next  record  indicating  end  of  GA  medical  benefits.  All 
other  records  were  deleted.  Subjects  with  a  start  of  benefits  record  but  no  end  of  benefits 
record  were  assigned  an  end  of  benefits  date  as  the  last  day  of  follow-up  (right  censored). 
Subjects  with  an  end  benefits  record  but  no  start  benefits  date  were  assigned  a  start  date 
as  the  beginning  of  follow-up  (left  censored).  In  the  Hartford  roster,  this  process  left  a 
total  of  41,152  medical  benefits  eligibility  episodes  for  26,334  unduplicated  clients.  In 
the  New  Haven  Roster,  I  was  left  with  32,804  medical  benefits  eligibility  episodes  for 
18,412  clients. 

These  GA  Roster  clients  were  then  linked  with  DMHAS  utilization  records  to 
determine  the  exact  date  when  a  GA  recipient  first  accessed  DMHAS  treatment,  and  to 
determine  if  each  instance  of  DMHAS  service  use  occurred  while  the  client  had  active 
GA  medical  coverage.  To  ensure  validity  of  the  linkage  process,  the  DMHAS  utilization 
database  was  subsetted  into  two  sets  of  unduplicated  clients,  and  each  set  was  separately 
linked  with  GA  Roster  records  for  each  city. 

The  first  set  of  linkages  occurred  with  the  GA  roster  for  each  city  and  an 
unduplicated  list  of  people  drawn  from  the  DMHAS  utilization  database  that  were 
evaluated  by  each  GAP  site  (2,799  people  screened  by  the  Hartford  GAP,  and  2,688 
people  screened  by  the  New  Haven  GAP).  The  GA  Roster  and  GAP  Assessment  records 
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were  linked  if  both  datasets  shared  two  of  three  following  fields:  Name:  Social  Security 
Number;  Date  of  Birth.  Fuzzy  matching  (inferring  matches  based  on  incomplete  or 
partially  mis-recorded  data)  was  also  used.  Because  every  person  with  a  GAP  assessment 
was  supposed  to  be  an  active  GA  client,  ideally,  I  would  expect  100%  of  those  subjects  to 
also  be  found  in  the  GA  rosters. 

I  was  able  to  link  2,459  Hartford  GAP  clients  with  Hartford  GA  roster  records 
(87.9%),  and  2,378  New  Haven  GAP  clients  with  New  Haven  Roster  (88.5%).  The 
magnitude  and  consistency  of  matching  was  quite  high  considering  the  quality  of  the 
source  datasets.  The  matching  procedures,  including  a  detailed  breakdown  of  linkage 
criteria,  are  more  thoroughly  explained  in  the  Appendix. 

The  small  number  of  clients  in  this  DMHAS  sub-dataset  made  it  a  good  testing 
ground  for  the  next  step:  matching  each  GA  Roster  to  the  entire  DMHAS  list  of  clients 
stored  in  a  demographic  database  (n  >  50,000  clients).  I  conducted  similar  matching 
process  with  the  GA  Rosters  and  the  full  DMHAS  demographic  database,  except  that  the 
GA  Roster  served  as  the  reference  in  this  series  of  linkages.  I  linked  2,835  records  in  the 
Hartford  datasets,  and  4,662  in  the  New  Haven  datasets. 

GA  clients  in  the  GAP  assessments  database  or  the  DMHAS  demographic 
database  had  all  of  their  DMHAS  utilization  records  pulled  from  the  DMHAS  databases. 
All  records  were  stripped  of  identifiers  (Name,  Social  Security  Number,  DMHAS  Unique 
Clinical  Identifier,  and  GA  case  number),  assigned  a  study  identification  number,  and 
downloaded  off  of  the  DMHAS  computer  server  for  analysis.  GA  Roster  subjects  that 
did  not  match  to  either  DMHAS  data  set  were  similarity  encrypted,  downloaded,  and 
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were  assumed  to  have  no  DMHAS  care.  This  definition  of  access  to  any  DMHAS  care 
will  be  further  explored  and  refined  in  later  sections. 

C.  Access  to  Care  Analysis 

Collocating  services  to  facilitate  screening  of  GA  clients  is  a  major  component  of 

the  program.  Screening  by  GAP  caseworkers  would  be  considered  access  to  care,  since  it 
is  a  formal  contact  with  the  behavioral  health  system.  A  screened  client  may  not  need 
additional  care,  or  may  decline  follow-up  services,  but  this  decision  could  never  be  made 
without  that  initial  contact.  Direct  treatment  services  (such  as  case  management, 
outpatient  therapy,  or  inpatient  hospitalization)  would  also  meet  the  definition  of  access 
to  any  care. 

1)  Hypothesis  and  measures 

These  access  definitions  suggest  the  following  hypothesis:  GA  Recipients  have 

greater  access  to  DMHAS  care  after  implementation  of  the  GAP.  The  combined  GA 
roster  and  DMHAS  utilization  files  provide  roughly  4  years  of  DMHAS  utilization  by 
GA  clients,  and  the  GAP  was  implemented  approximately  1  year  into  follow-up.  This 
hypothesis  will  be  tested  by  simultaneously  comparing  the  rates  of  access  before  and 
after  GAP  implementation,  and  comparing  access  to  care  among  those  who  have  and  do 
not  have  active  GA  medical  coverage. 

The  length  of  the  follow-up  period  offers  additional  complications  and 
advantages.  GAP  policies  changed  over  time,  potentially  making  a  pre/  post  design 
inaccurate.  However,  if  any  variation  in  post-implementation  outcomes  can  be  attributed 
to  any  of  policy  change  or  event,  it  would  provide  further  insight  into  the  GAP  model. 
For  these  reasons,  follow-up  time  will  be  divided  into  multiple  policy  periods,  that  have 
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their  number  and  length  based  on  dates  of  key  policy  changes.  These  policy  periods  will 
be  further  defined  in  later  sections. 

The  definition  of  access  to  care  can  be  further  refined.  Any  DMHAS  service,  be 
it  a  GAP  screen  or  standard  treatment  visit,  results  in  the  opening  of  an  'electronic  chart' 
of  a  DMHAS  unique  clinical  identifier.  These  subjects  remain  a  'DMHAS  client'  with  a 
recognized  clinical  history  at  DMHAS  for  the  rest  of  their  lives,  and  arguably  they  have  a 
familiarity  and  access  with  DMHAS  facilities  that  is  independent  of  their  GA  medical 
coverage. 

To  understand  how  the  GAP  can  increase  access  to  DMHAS  care  for  GA  clients, 
the  access  outcome  is  defined  as  the  first  recorded  DMHAS  contact  within  the  follow-up 
period.  Subjects  with  DMHAS  records  before  their  entry  into  a  GA  roster  (the  start  of 
their  first  known  GA  episode,  or  the  start  of  the  follow-up,  whichever  comes  last)  were 
dropped  from  the  access  analysis.  Even  though  this  restriction  process  cannot  account  for 
GA  enrollment  ('exposure')  before  the  follow-up,  it  does  ensure  that  GA  care  precedes 
first  DMHAS  contact.  Restriction  leaves  15,339  subjects  in  New  Haven,  and  24,849 
subjects  in  Hartford. 

The  definition  of  access  is  further  complicated  in  that  not  necessarily  all  GA 
clients  need,  or  benefit  from,  GAP  screens.  DMHAS  could  have  spent  much  of  the  GAP 
resources  trying  to  screen  every  GA  recipient  with  its  current  intensity  of  screens,  or 
screen  every  GA  recipient  in  a  more  cursory  fashion  for  the  same  funds,  and  both 
measures  would  have  improved  access  to  care  in  a  technical  sense,  though  it  would  not 
lead  to  an  efficient  program.  Having  a  clinician  perform  a  45  minute  to  2  hour  screen  on 
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a  GA  recipient  with  no  clinical  need  is  expensive,  and  possibly  even  unnecessary  and 
obtrusive  for  GA  recipients. 

The  target  efficiency  of  these  screens  should  therefore  also  be  evaluated.  Lacking 
any  concrete  measures  of  severity,  and  only  having  diagnostic  data  on  most  of  the  clients 
who  received  any  treatment,  the  best  way  to  measure  efficiency  is  to  see  if  the  initial 
DMHAS  contact  leads  to  any  subsequent  DMHAS  care  within  30  days  of  the  initial 
contact,  or  if  the  initial  episode  of  care  lasted  longer  than  one  day.  Obviously,  this 
measure  will  ignore  any  referrals  made  to  providers  outside  of  DMHAS,  which  was  a 
major  treatment  strategy  in  the  New  Haven  GAP  for  substance  abuse  services.  This  bias 
can  be  minimized  by  stratifying  the  location  of  the  initial  contact  into  the  substance  abuse 
clinic,  and  the  collocation  site. 

The  second  complication  is  probably  unique  to  public  sector  providers.  DMHAS 
is  obligated  to  treat  all  indigent  people  needing  services  regardless  of  their  medical 
insurance  status.  Subjects  could,  and  did,  receive  their  incident  DMHAS  contacts  during 
the  follow-up  when  they  did  not  have  active  GA  medical  coverage.  Since  the  GAP  is 
only  designed  for  clients  with  active  GA  medical  benefits,  clients  can  serve  as  a  control 
for  themselves  and  others  when  they  are  not  on  GA,  and  give  a  baseline  estimate  for 
access  to  DMHAS  services  by  inactive  GA  clients  both  before  and  after  implementation 
of  the  GAP. 

Combined,  the  access  outcome  can  now  be  defined  in  5  different  strata:  0)  No 
care  during  the  follow-up;  1)  an  incident  treatment  episode  with  follow-up  care  while  on 
GA;  2)  an  incident  treatment  episode  with  follow-up  care  while  off  GA;  3)  an  incident 
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treatment  episode  with  no  follow-up  care  while  on  GA;  and  4)  an  incident  treatment 
episode  with  no  follow-up  care  while  off  GA. 

2)  Determining  the  policy  periods 

The  Hartford  and  New  Haven  GAPs  were  implemented  in  slightly  different  times, 

and  had  other  key  events  occur  that  may  have  an  impact  on  access  to  care.  The  following 

two  graphs  (Figures  4-1  and  4-2  )  display  monthly  raw  incident  treatment  rates  for  the 

first  known  access  to  DMHAS  treatment  per  thousand  people  remaining  in  the  cohorts, 

stratified  by  whether  the  treatment  occurred  while  they  were  covered  by  GA  medical 

benefits.  Subjects  are  removed  from  the  denominator  when  they  have  their  incident 

treatment.  This  procedure  slightly  underestimates  the  rates,  since  subjects  cannot  be 

considered  eligible  for  DMHAS  care  if  they  die,  move  out  of  state,  or  are  incarcerated  or 

hospitalized.  In  New  Haven,  1,748  clients  had  an  incident  treatment,  and  in  Hartford, 

2,154  had  an  incident  treatment. 

Key  programmatic  events  are  superimposed  below  each  graph.  The  date  and 

significance  of  these  events  are  derived  from  written  documents  and  interviews. 
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Figure  4-1:  Hartford  Crude  Incidence  Rates  and  Key  Policy  Events 

Hartford    Incident  Treatment  Rates    per  Thousand 

3  5  -.  


Figure  4-2:  New  Haven  Crude  Incidence  Rates  and  Key  Policy  Events 

New    Haven    Incident   Treatment   Rates    per   T  h  o  u  ft  a  n  d 
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a)  Socio-Demographic  Variables 

Unfortunately,  much  of  the  richness  in  the  available  data  is  contained  in  the 

DMHAS  demographic  file,  and  obviously  this  information  was  not  collected  if  the 

subject  received  no  DMHAS  services. 

Age  was  the  only  available  demographic  variable  in  the  New  Haven  data  set.  All 

ages  for  all  analyses  are  determined  by  a  client's  date  of  birth  from  the  start  of  that 

follow-up  period.  For  simplicity's  sake,  age  is  held  constant  over  the  various  policy 

periods. 

In  Hartford,  more  detailed  demographic  information  was  available  through  the 
GA  Roster.  Race  and  Ethnicity  data  was  collapsed  into  one  variable  with  levels 
indicating  non-Hispanic  Blacks,  non-Hispanic  Whites,  Hispanics,  and  people  of  other 
races  and  ethnicity.  Age  and  Sex  were  also  available. 

Sex  and  the  racial  data  simultaneously  control  both  for  help  seeking  behavior  on 
the  part  of  the  subject,  and  the  openness  of  the  DMHAS  service  system  to  people  with 
these  characteristics.  While  it  is  certainly  possible  that  individual  clinicians  or  the 
institutions  may  have  some  bias  favoring  of  some  groups  over  others,  it  is  more  likely 
that  broad  capacity  limits — like  the  number  of  female  beds  in  a  segregated  ward  or  the 
number  of  bilingual  clinicians — may  differentially  affect  access  for  certain  minority 
groups. 

Interpreting  findings  about  Age  is  less  clear.  One  could  assume  that  older  people 
needing  assistance  have  probably  had  their  illness  for  a  longer  time  and  are  therefore 
more  severely  in  need.  On  the  other  hand,  symptoms  of  substance  abuse  and  many  forms 
of  mental  illness  are  hypothesized  to  decline  with  age. 
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b)  General  Assistance  Episode  information 

In  both  data  sets,  certain  information  was  also  available  on  each  GA  episode  that 

may  have  affected  access  to  care.  First  is  the  number  of  (collapsed)  episodes  of  general 

assistance  medical  coverage.  Each  episode  of  GA  medical  coverage  is  preceded  by  a 

formal  GA  intake,  which  may  provide  the  best  opportunity  for  a  GA  Caseworker  to 

understand  a  client's  needs  and  refer  them  to  behavioral  health  services. 

Another  factor  to  consider  is  when  a  client  is  eligible  for  care.  Clients  can  only 
have  their  incident  DMHAS  contact  once,  but  their  entire  GA  history  prior  to  contact 
influences  that  one  event  (or  non-event).  Being  enrolled  under  one  policy,  or  the 
combination  of  enrollment  under  several  policies,  may  influence  the  likelihood  of  access 
to  care.  For  example,  a  pattern  in  these  variables  may  reflect  the  ways  in  which  GA 
Caseworkers  interacted  with  subjects  and  DMHAS,  or  the  severity  of  a  client's  needs,  or 
the  client's  skill  in  negotiating  a  system.  Therefore,  I  created  one  Yes/No  variable  for 
each  period  indicating  if  the  subject  was  covered  by  GA  medical  benefits  at  any  time 
during  a  period.  These  variables  are  important  in  correcting  potential  errors  in  statistical 
models,  and  will  be  discussed  again  later. 

There  is  also  some  detail  on  what  type  of  benefits  (in  addition  to  medical 
coverage)  was  being  granted  by  general  assistance,  though  this  information  was  carried 
over  from  the  first  GA  transaction  of  the  several  transactions  that  could  have  been 
collapsed  to  form  an  episode  of  GA  medical  coverage.  Start  codes  indicate  if  a  client's 
benefits  were  intended  for  housing,  rent  relief,  or  medical  benefits  only.  A  separate  level 
noted  if  that  information  was  missing  because  the  episode  was  left  censored.  Because  of 
the  high  rate  of  left  censored  information  in  the  Hartford  data  base,  this  variable  was  not 
used  in  Hartford  analyses. 
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Stop  codes  are  five  level  variables  in  both  data  sets  that  were  drawn  from  the  last 
transaction  that  ended  an  episode  of  medical  eligibility.  The  levels  are:  found 
employment  or  other  private  aid;  received  other  government  assistance;  non-compliance 
resulting  in  termination  (in  the  case  of  terminating  medical  benefits,  usually  due  to  failure 
to  produce  or  process  some  paperwork);  other  reasons  such  as  fraud  or  being  over  income 
or  asset  limits;  or  right  censoring  due  to  the  end  of  the  follow-up  or  accessing  care  during 
a  GA  episode. 

Though  this  variable  appears  interesting  in  its  own  right,  its  results  should  be 
interpreted  with  caution  because  of  the  procedure  used  to  collapse  GA  Roster  records  into 
episodes  of  GA  medical  eligibility.  These  are  only  the  stop  codes  that  occurred  at  the 
time  of  the  event — the  others  have  been  dropped.  It  is  not  worth  exploring  the  stop  codes 
as  an  outcome  themselves  because,  as  discussed  in  Chapter  2,  DMHAS  claimed  to  have 
helped  very  few  clients  get  off  of  GA  and  onto  other  benefits,  and  allocated  few  resources 
specifically  for  this  task.  This  variable  will  be  better  interpreted  as  a  covariate  that 
indirectly  accounts  for  each  client's  level  of  need. 

4)  Modeling  access  to  care 

Modeling  the  relationship  between  GAP  policies  and  five  levels  of  access  to 

DMHAS  services  is  complex.  Variations  on  traditional  proportional  hazards  modeling 
(Wei,  Lin  &  Weissfeld,  1989;  Prentice,  Williams  &  Peterson,  1981)  can  describe  a  five 
level  outcome  repeated  over  six  periods.  However,  those  models  were  designed  to 
handle  the  repeated  time  elements  as  nuisance  parameters  to  be  stratified  on,  rather  than 
key  independent  variables,  so  additional  adjustments  would  have  been  required  to 
understand  the  policy  effects. 
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Another  option  was  to  model  the  outcome  through  a  nominal  logit  link  repeated 
over  six  policy  periods.  The  correlation  between  repeated  measures  could  be  minimized 
by  modeling  each  individual  subject  as  a  random  effect  (Laird  &  Ware,  1982;  Hedeker  & 
Gibbons,  1994).  These  methods  have  been  used  successfully  in  other  social  science 
studies  (e.g.  Cruris,  1993)  and  appeared  quite  robust.  To  account  for  the  differing  lengths 
of  follow-up  time  per  client,  the  portion  of  time  on  GA  in  a  given  time  period  would  be 
included  as  a  continuous  covariate.  The  only  available  software  that  can  run  such  a 
model  is  MIXNO  (Hedeker,  1997).  Despite  the  author's  help,  I  could  not  get  this 
application  to  run  any  models. 

A  similar  nominal  logistic  model  could  be  run  on  SUDAAN  7.0's  MULTILOG 
procedure  (Research  Triangle  Institute,  1996)  that  accounted  for  within-subject 
correlation  across  repeated  observations  through  Generalized  Estimating  Equations  (GEE 
models).  GEE  models  are  similar  to  random  effects  models,  except  that  GEE  models 
only  estimate,  instead  of  directly  calculate,  subject  covariance  structures  at  each  time 
point  (Miller,  Davis  &  Landis,  1993;  Lipsitz  &  Kim,  1994;  Liang  &  Zeger,  1986;  Zeger, 
Liang  &  Albert,  1988),  thereby  leading  to  less  computer  intensive  models. 

Several  nominal  logistic  GEE  models  were  tried  using  SUDAAN  7.0's 
MULTILOG  procedure.  Models  with  reduced  data  sets  sizes  would  not  run  with  the 
proportion  of  GA  time  variable.  Reduced  models  with  all  subjects  were  tried  several 
times,  and  allowed  to  run  undisturbed  for  up  to  70  hours  on  a  233  MHz  Pentium  II  before 
termination.  SUDAAN  does  not  provide  any  output  when  a  procedure  is  prematurely 
terminated,  and  no  model  with  a  full  population  ever  finished  running. 
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a)  Poisson  GEE  modeling 

Therefore,  I  abandoned  the  five  level  outcome  in  favor  of  a  two  stage  model 

building  process.  The  first  step  was  to  model  the  rate  of  incident  treatment  while  people 

were  on  GA  and  while  people  were  off  GA.  This  would  be  accomplished  through  a 

Poisson  GEE  regression  that  interacted  insurance  status  at  time  of  incident  treatment  with 

the  policy  period.  The  resulting  model  parameter  estimates  plus  the  intercept  would  yield 

the  log  of  the  average  daily  incident  treatment  rate  per  policy  period  among  those  who 

were  on  GA  when  they  received  treatment  (or  when  they  had  no  event  at  the  end  of  the 

period)  and  those  off  GA  when  they  received  treatment.  The  second  step  would  be  to 

model  the  likelihood  of  follow-up  care  only  among  those  who  received  any  treatment 

(this  Target  efficiency  model  will  be  addressed  in  greater  detail  in  a  later  section). 

A  Poisson  model  is  more  accurate  than  a  logistic  model  in  that  it  accounts  for 

both  the  speed  to  and  frequency  of  an  outcome.  I  also  find  Poisson  models  more  useful 

for  applied  research  in  that  they  directly  model  rates,  which  are  easier  to  interpret  than 

hazard  functions. 

The  repeated  measures  element  adds  a  further  layer  of  complexity  to  this 
application  of  Poisson  modeling.  An  individual  subject  must  be  fit  as  a  random  effect  to 
control  for  their  unknown  severity  of  illness.  This  severity  is  assumed  to  stay  the  same 
without  DMHAS  services  (though  if  some  portion  of  subjects  experienced  an  increase  in 
severity  and  a  similar  portion  experienced  a  decrease,  it  could  only  negatively  bias  the 
model).  For  example,  having  no  events  over  five  periods  should  decrease  the  expectation 
of  accessing  care  in  the  sixth  period.  One  way  to  describe  this  relationship  is  to  have  the 
GEE  models  not  specify  a  correlation  structure  between  time  periods.  In  other  words, 
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period  6  could  be  influenced  by  period  1,2,  and  4  just  as  easily  as  by  period  5,  if  that 
leads  to  the  best  fitting  model. 

However,  this  method  would  minimize  the  role  played  by  patterns  of  GA 
enrollment  in  access  to  care  across  periods,  which,  as  discussed  earlier,  is  reasonable  to 
assume  would  have  an  effect.  Some  combination  of  enrollment  patterns,  (e.g.  being 
enrolled  on  GA  for  three  consecutive  periods),  may  confound  the  relationships  between 
policy  time  and  GA  status.  Including  the  complete  vector  of  six  GA  enrollment  indicator 
variables  in  the  Poisson  GEE  model  allows  GA  enrollment  patterns  to  add  structure  to 
correlations  across  time  periods,  but  only  in  relation  to  GA  enrollment. 

Therefore,  Poisson  GEE  models  were  run  on  SAS  6.12's  GENMOD  procedure 
(SAS,  1990),  with  unstructured  correlations  across  periods  and  standard  errors  scaled  by 
the  deviance  divided  by  the  degrees  of  freedom  (to  correct  for  over-dispersion). 
However,  using  GENMOD  caused  to  two  other  problems.  First,  due  to  colinearity,  these 
models  would  not  converge  when  the  portion  of  time  on  GA  variable  and  the  GA  status  at 
outcome  were  included  together,  so  the  portion  of  time  spent  on  GA  variable  was 
dropped.  Second,  this  version  of  SAS  does  not  calculate  its  likelihood  ratio  tests  or 
scaled  deviance  from  values  adjusted  by  the  GEE  process.  Model  building  can  only  be 
performed  accurately  using  Wald  tests. 

b)  Collapsibility 

Before  modeling  the  six  policy  periods  could  commence,  the  validity  of  the  six 
policy  periods  had  to  be  confirmed.  Despite  the  appearance  of  the  raw  data,  collapsing 
the  monthly  averages  in  Figures  4-1  and  4-2  into  one  average  daily  rate  per  period  could 
mask  important  variation  within  each  period.  To  rule  out  this  unlikely  occurrence,  I 
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divided  each  policy  period  in  half,  to  create  12  sub-periods.  The  dates  and  lengths  are 
presented  below: 


Table  4-5:  Subperiod  dates  and  length  for  access  analysis 


New  Haven 

Hartford 

Time  Unit 

Start 

Stop 

Length 

Start 

Stop 

Length 

•  'rW&- 

*m  1 

Subperiod  1 

8/31/92 

1/31/93 

154 

4/1/92 

11/15/92 

229 

Subperiod  2 

2/1/93 

6/30/93 

150 

11/16/92 

6/30/93 

227 

leOo§i!fHHi 

Subperiod  3 

7/1/93 

10/15/93 

107 

7/1/93 

9/15/93 

77 

Subperiod  4 

10/16/93 

1/31/94 

108 

9/16/93 

11/30/93 

76 

Subperiod  5 

2/1/94 

7/31/94 

181 

12/1/93 

8/15/94 

258 

Subperiod  6 

8/1/94 

mm 

1/31/95 

184 

8/16/94 
5/ 1  /9  5^v^*^k 

4/30/95 

258 

Subperiod  7 

2/1/95 

4/15/95 

^74 

7/15/95 

76 

Subperiod  8 

4/16/95 

6/30/95 

76 

7/16/95 

9/30/95 

77 

:  mm& 

"  ^£4?  ■ 

Subperiod  9 

7/1/95 

11/15/95 

138 

10/1/95 

11/30/95 

61 

Subperiod  10 

11/16/95 

3/31/96 

137 

12/1/95 

1/31/96 

62 

Lpii©'  . 

—  if?*?*;-. 

Subperiod  11 

4/1/96 

6/15/96 

76 

2/1/96 

5/15/96 

105 

Subperiod  12 

6/16/96 

8/31/96 

77 

5/16/96 

8/31/96 

108 

Total  Follow-up  per  city 

1462 

1614 

The  collapsibility  of  each  Subperiod  was  tested  by  fitting  a  Poisson  GEE  model  of 
receipt  of  any  care  by  the  12  subperiods.  Confidence  intervals  were  calculated  for  each 
Subperiod  and  then  graphically  displayed.  The  boxed  subperiods  indicate  pairs  of 
subperiods  to  be  collapsed  into  periods.  If  the  confidence  intervals  within  each  period 
overlapped,  then  collapsing  these  two  subperiods  into  one  period  would  be  appropriate. 
A  graph  for  each  site  is  displayed  below.  Note  that  a  positive  constant  was  added  to 
each  linear  predictor  to  keep  the  graph  scales  manageable. 
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Figure  4-3:  Hartford  access  collapsibility  test 
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Figure  4-4:  New  Haven  access  collapsibility  test 
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As  the  graphs  illustrate,  there  all  pairs  of  subperiods  have  overlapping  confidence 
intervals.  These  finding  suggests  that  it  is  appropriate  to  collapse  these  12  time  periods 
into  6  for  both  sites.  Though  the  graphs  may  justify  further  collapsing,  I  will  not,  as  it  is 
important  to  preserve  detail  in  programmatic  variation  for  two  reasons.  First,  it  preserves 
any  steady  trends  if  the  periods  were  modeled  continuously.  Second,  it  will  allow  for 
unexpected  deviation  in  trends  that  may  result  from  various  policy  shifts,  but  are  masked 
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in  these  unadjusted  models.  This  model  building  process,  its  results,  and  statistical  cross- 
site  comparisons,  will  be  discussed  in  Chapter  6. 

D.  Target  Efficiency  analyses 

The  second  aspect  of  modeling  access  is  considering  how  many  clients  that  have 

contact  with  DMHAS  may  have  received  services  in  response  to  that  contact.  More 
specifically,  I  explore  the  likelihood  of  the  initial  DMHAS  contact  being  longer  than  one 
day,  or  resulting  in  any  follow-up  services  within  30  days  of  first  contact,  among  those 
that  received  any  care.  Note  that  by  this  definition,  clients  receiving  a  one  session 
episode  of  brief  treatment  at  first  contact  would  get  counted  as  a  null  outcome  (or  non- 
event)  .  These  models  concern  only  one  event,  (the  disposition  of  the  initial  treatment) 
so  no  time  elements  need  be  considered  other  than  the  period  in  which  the  initial 
treatment  occurred.  Below  are  further  detail  on  covariates. 

1)  Covariates  of  interest 

Since  these  subjects  have  entered  DMHAS  treatment,  much  more  information 

about  them  is  available. 

a)  Socio-Demographic  variables 

For  both  sites,  Race  and  Ethnicity  data  were  collapsed  into  one  variable  with 

levels  indicating  non-Hispanic  Blacks,  non-Hispanic  Whites,  Hispanics,  and  people  of 

other  races  and  ethnicity.  Age  and  Sex  were  also  available,  as  was  marital  status,  primary 

language,  and  education  level.  Due  to  the  high  level  of  missing  data,  these  variables  were 

handled  differently  across  sites,  and  will  be  explained  in  further  detail  in  Chapter  6. 


12  Though  to  my  knowledge,  the  GAPs  and  DMHAS  do  not  use  this  intervention. 
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In  addition  to  the  variables  described  in  the  Access  to  care  demographics  section, 
marital  status  and  language  give  us  a  more  refined  picture  about  the  lives  of  GAP  clients. 
Marital  status  is  a  good  indicator  of  social  support,  and  in  a  prior  studies  of  DMHAS 
data,  people  who  were  actively  married  or  cohabiting  were  less  likely  to  be  readmitted  to 
inpatient  substance  abuse  treatment  (Thakur,  Hoff,  Druss  &  Catalanotto,  1998). 
Language  may  indicate  that  a  client  is  more  likely  to  access  services  through  DMHAS 
programs  designed  especially  to  treat  Spanish  speaking  clients. 

b)  GA  variables 

In  addition  to  variables  indicating  during  which  policy  periods  a  client  was 
enrolled  on  GA,  two  other  GA  status  variables  can  be  included.  First  is  a  variable 
indicating  the  policy  period  of  the  incident  treatment.  Because  of  the  small  sample  sizes, 
it  was  necessary  to  collapse  the  six  policy  periods  into  a  pre/post  GAP  variable. 
Information  on  whether  the  GAPs  or  another  part  of  DMHAS  provided  the  initial  contact 
is  also  available,  and  should  offer  additional  detail  on  exactly  how  and  what  the  GAPs 
did  to  expand  access  to  care  at  their  LMHAs. 

c)  Diagnostic  information 

DMHAS  utilization  systems  can  also  record  a  diagnosis  or  provisional  diagnosis 

at  the  initial  contact.  Diagnoses  are  important  because  they  determine  the  type  of 
services  that  clients  will  receive.  Some  clients  screened  may  be  so  asymptomatic  that 
they  may  not  be  assigned  a  diagnosis  at  all. 

As  discussed  in  Chapter  2,  DMHAS  LMHAs  have  traditionally  been  most 
focused  on  clients  with  Axis  1  disorders  or  clients  who  have  both  mental  illness  and 
substance  abuse  disorders.  Clients  with  a  primary  substance  abuse  disorder  are  a  new 
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and  unfamiliar  population  to  the  LMHAs,  and  one  of  the  primary  target  populations  for 
the  New  Haven  GAP.  However,  the  New  Haven  GAP  intended  to  treat  many  of  these 
clients  by  referring  them  to  non-DMHAS  providers. 

Diagnosis  is  stored  in  the  DMHAS  databases  as  DSMIII-R  and  DSM-IV  codes 
(APA,  1994).  Each  client  could  be  assigned  a  primary  and  secondary  diagnosis.  Clients 
were  classified  into  a  diagnostic  category  by  combining  information  from  their  primary 
and  secondary  diagnoses.  If  any  combination  of  the  primary  diagnosis  and  the 
secondary  diagnosis  were  an  Axis  1  mental  disorder  and  a  substance  abuse  related 
diagnosis,  the  client  was  coded  as  a  Mentally  111  Substance  Abuser  (MISA).  Otherwise, 
Substance  Abuse  and  Axis  1  mental  disorder  information  is  retained  regardless  of 
whether  it's  the  primary  or  secondary  diagnosis,  and  other  information  is  ignored.  If 
neither  of  these  two  diagnostic  categories  were  present,  then  the  client  was  accordingly 
categorized  into  the  other  diagnosis,  or  as  missing.  The  following  table  summarizes  how 
these  codes  were  categorized: 

Table  4-6:  Summarizing  DSM  Codes 


Diagnostic 
Category 

DSM  Codes 

Substance  Abuse 

291.00-291.99;  292.00-292.99;  303.00-305.99 

Axis  1  Mental 
Disorder 

290.00-290.99;  294.00-295.99;  296.00-296.06;  296.20-296.36; 
296.40-296.89;  300.00-300.82;  296.90;  300.9;  298.9;  298.90 

Other  Diagnoses 

All  other  codes 

Since  follow-up  care  is  a  common  outcome,  typical  logit  link  models  would  yield 


biased  results.  Relative  risk  regression  avoids  this  error  by  using  a  simple  log  link,  and 
yield  parameter  estimates  that  can  be  exponentiated  into  relative  risks  (Wacholder,  1986). 
Since  the  samples  are  small  (1,748  subjects  from  New  Haven  and  2,154  subjects  from 
Hartford),  model  building  proceeded  smoothly.  The  results  are  presented  in  Chapter  5. 
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E.  Modeling  total  direct  costs 

The  GAP  is  also  designed  to  change  utilization  patterns  for  its  recipients  (see 

Figure  2-1).  To  control  costs,  the  GAP  seeks  to  lower  the  use  of  inpatient  care  and 
increase  the  use  of  community  based  treatment.  However,  the  GAP  could  perform  this 
substitution  too  severely  and  worsen  the  clinical  progress  of  its  clients.  Good  measures 
of  severity,  or  other  indicators  of  treatment  failure  or  cost  shifting  such  as  emergency 
department  visits,  are  needed  to  judge  the  quality  of  substitution.  However,  these  data 
are  not  available.  Instead,  DMHAS  utilization  data  can  determine  if  care  substitution  is 
occurring,  though  it  cannot  determine  the  quality  of  substitution  (in  terms  of  Figure  2-1  it 
cannot  distinguish  between  'appropriate  substitution'  and  'over  substitution'). 

The  measurable  variation  in  managed  care  protocols  between  Hartford  and  New 
Haven  (see  figures  3-4  and  3-5)  are  somewhat  lessened  when  data  is  restricted  to 
DMHAS  utilization.  Though  New  Haven  has  a  utilization  management  model  with  more 
authority,  clients  from  both  GAPs  must  pass  through  a  DMHAS  prior  authorization 
process  that  the  GAPs  have  no  influence  over  before  receiving  inpatient  services. 
Therefore,  GAP  utilization  management  can  only  make  DMHAS  inpatient  utilization 
review  more  stringent.  The  GAPs  can  still  have  complete  control  the  intensity  of 
outpatient  care,  and  control  use  of  inpatient  care  substitutes.  Hartford's  less  direct 
control  over  DMHAS  services  compared  to  New  Haven's  suggests  that  the  New  Haven 
GAP  may  be  able  to  control  DMHAS  utilization  with  more  finesse. 

Available  data  can  be  used  to  determine  if  treatment  intensity  has  decreased  or 
increased.  One  measure  that  could  make  this  distinction,  the  ratio  of  dollars  spent  on  out- 
patient treatment  versus  the  dollars  spent  on  inpatient  treatment  for  some  time  period,  is 
unfeasible.  A  subject  would  have  to  have  some  care  during  all  time  periods,  because  no 
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care  of  any  sort  =  $0  outpatient  costs/$0  inpatient  costs.  Adding  a  constant  to  one  or  both 
of  these  Os  will  only  further  distort  the  ratio.  Setting  0/0  to  missing  will  select  out  all  but 
the  highest  resource  utilizers. 

A  simpler  but  more  effective  solution  is  to  model  direct  DMHAS  treatment  costs 
over  the  various  policy  periods.  Again,  this  analysis  cannot  address  how  the  GAP 
influences  non-DMHAS  treatment  (which  the  GAPs  were  also  designed  to  do),  and  the 
GAP  may  in  fact  lower  DMHAS  direct  costs  simply  by  referring  clients  to  outside 
providers  in  greater  frequency.  Despite  these  larger  issues,  costs  within  DMHAS  still 
represent  resources  used,  and  during  the  GAP,  they  were  the  only  costs  DMHAS  actually 
paid  for. 

In  addition,  increasing  the  use  of  community  based  treatment  is  a  goal  for  the 
entire  public  sector  behavioral  health  system,  not  just  the  GAP,  and  it  is  possible  that  all 
DMHAS  facilities  are  decreasing  costs  over  time  through  this  substitution  process.  To 
test  this,  not  only  must  I  make  pre/post  GA  comparisons,  but  on  GA/off  GA  comparisons 
within  each  policy  period  as  well.  I  have  DMHAS  utilization  cost  data  for  the  times 
when  the  cohort  had  no  GA  medical  coverage,  and  were  not  being  managed  by  the  GAP, 
which  will  allow  me  to  make  these  comparisons. 

1)  Defining  Costs 

Defining  direct  costs  for  DMHAS  services  is  difficult  given  their  accounting 
systems.  DMHAS  does  have  the  capacity  for  third  party  billing,  through  DSS's  Bureau 
of  Collection  Services.  The  Bureau  has  a  huge  backlog,  and  can  take  up  to  1 8  months  to 
process  a  bill.  Revenue  from  these  bills  go  into  the  state  General  Fund  and  is 
independent  of  DMHAS  budgetary  allocations.  These  billing  charges  are  not  designed  to 
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reflect  the  cost  DMHAS  spends  to  provide  these  services,  but  are  rather  to  maximize 
Medicaid  disproportionate  share  payments.  A  team  of  university  based  economists 
generated  their  own  New  Haven  LMHA  cost  estimates,  and  they  were  kind  enough  to 
lend  their  findings  to  me  for  this  analysis  (Tebes,  Wolff  &  Helminiak,  1998).  These  cost 
estimates  have  been  the  basis  for  at  least  one  peer-reviewed  paper  (Sledge,  Tebes,  Wolff 
&  Helminiak,  1996). 

The  Tebes  team  generated  estimates  of  1994  total  costs  by  calculating  the  total 
expenses  for  a  given  service  unit  at  the  New  Haven  LMHA  and  dividing  it  by  the  total 
number  of  service  hours  delivered.  These  total  cost  estimates  are  not  generalizable  to 
other  DMHAS  facilities  because  each  facility  may  have  very  different  allocations  of 
capital  costs  versus  direct  staff  costs.  Using  correction  factors  the  Tebes  team  also 
provided  to  me  (47.19%  for  ambulatory  services  and  47.37%  for  inpatient  services),  I 
was  able  to  isolate  the  portion  of  total  costs  due  to  direct  staff  hours.  These  numbers 
should  be  generalizable  to  other  facilities,  not  in  the  sense  that  direct  staff  costs  estimates 
would  necessarily  be  the  same  across  sites,  but  in  that  the  ratios  between  different  direct 
costs  categories  (e.g.  group  therapy  vs.  individual  therapy)  are  constant.  In  this  respect, 
direct  costs  used  in  the  model  are  more  measures  of  relative  resource  intensity  for 
services  provided  than  they  are  measures  of  dollars  spent. 

I  calculated  the  average  costs  per  program,  but  did  not  include  the  Assertive 
Community  Treatment  team  cost  estimates  and  the  Substance  Abuse  Treatment  Unit  cost 
estimates  in  this  mean,  as  GA  clients  are  not  very  likely  to  use  Assertive  Community 
Treatment  services,  and  no  other  DMHAS  facility  has  a  specialized  outpatient  substance 
abuse  treatment  clinic.  Further,  since  no  reliable  utilization  data  is  available  on  substance 
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abuse  inpatient  services,  costs  for  substance  abusers  are  not  likely  to  be  very  accurate. 
The  final  estimates  used  in  the  models  are  presented  below. 


Table  4-7:  1994  direct  cost  estimates 


Service  Category 

Estimated  Direct  costs 

Emergency  Crisis  Screening/  Medical  Evaluation/GAP  Screening 
Individual  Therapy/  Medication  Management/  Case  Management 
Group  Services  of  any  sort 
Day  hospital 
Inpatient  Care 

$  127.73  per  hour 
$  129.17  per  hour 
$    28.35  per  hour 
$  119.50  per  day 
$  331 .83  per  day 

GAP  screenings  are  grouped  with  medical  evaluations.  GAP  staff  have  the  same 
level  of  training  as  the  staff  that  provide  medical  evaluations  for  the  rest  of  their  LMHAs. 
The  differing  intensity  in  screening,  (if  any)  is  captured  in  the  duration  of  the  screening. 
The  New  Haven  GAP  claims  its  average  screening  takes  45  minutes,  and  the  Hartford 
GAP  claims  its  average  screening  takes  2  hours.  The  exact  duration  of  other  types  of 
screenings  are  recorded  on  the  DMHAS  service  logs,  and  vary  by  client  and  workload. 

It  is  interesting  to  note  that  under  these  cost  estimates,  a  day  of  inpatient  treatment 
is  not  always  the  most  resource  intensive  treatment  option.  A  two  hour  assessment 
followed  by  one  session  of  therapy  in  one  day  is  more  costly  than  one  day  of  inpatient 
care.  This  is  not  an  unreasonable  assumption  since  only  a  portion  of  an  inpatient  day  is 
actually  spent  in  treatment  with  staff. 

2)  Defining  policy  periods 

Policy  periods  for  modeling  direct  costs  are  somewhat  different  than  in  the  access 

analysis.  The  first  major  difference  in  policy  periods  are  that  information  on  costs  ends 
6/30/96  (see  Section  3  of  the  Appendix  for  a  full  explanation).  Second,  implementation 
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of  DMHAS's  statewide  prior  authorization  program  of  all  inpatient  admissions  may  have 
a  critical  effect  on  utilization  patterns. 

Each  LMHA  has  a  team  that  specializes  in  emergency  crisis  assessments  and 
certifies  each  DMHAS  inpatient  admission  (this  process  applies  even  to  GAP  clients 
approved  for  inpatient  care  by  GAP  utilization  review).  Typically  the  crisis  team 
conducts  a  thorough  assessment,  and  either  recommends  a  client  for  inpatient  service  or 
finds  a  more  appropriate  level  of  service.  The  New  Haven  crisis  team  usually  conducts 
assessments  at  the  LMHA  or  at  the  Yale  New  Haven  Emergency  room  (which  is  across 
the  street),  from  the  LMHA  and  became  active  January  1,  1993.  The  Hartford  team  is 
more  mobile,  and  can  go  to  any  emergency  room  or  public  place  in  Hartford,  or  even  to  a 
client's  home.  This  team  became  active  March  1, 1993.  These  dates  mark  the  end  of  the 
first  Subperiod. 

These  changes  result  in  1,552  days  of  follow-up  for  Hartford  and  1,400  days  of 
follow-up  for  New  Haven.  To  maintain  some  sort  of  comparability  with  the  access 
analysis,  access  Subperiod  start  and  stop  dates  were  used  where  ever  possible,  and  only 
changed  for  the  prior  authorization  units  and  the  changed  end  of  follow-up  date,  resulting 
in  1 1  subperiods  instead  of  12.  The  first  two  subperiods  and  the  last  also  serve  as  full 
policy  periods  when  running  collapsed  models,  and  the  3rd  and  4th,  and  5th  and  6th,  and  7th 
and  8th,  are  collapsed  to  make  four  other  periods,  for  a  total  of  seven  periods"  in  all.  The 
dates  and  their  lengths  are  described  in  the  following  table. 
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Table  4-8:  Subperiod  dates  and  lengths  for  cost  analysis 


New  Haven 


Hartford 


Time  Unit 


Subperiod  1 
e 

Subperiod  2 

m 

Subperiod  3 
Subperiod  4 


mm, 


Subperiod  5 
Subperiod  6 

Subperiod  7 
Subperiod  8 


Subperiod  9 
Subperiod  10 


Subperiod  1 1 


Start 


8/31/92 


Stop 


7/1/93 
10/16/93 

"2/1/94 

8/1/94 


10/15/93 
1/31/94 

7/31/94 
1/31/95 


2/1/95 
4/16/95 

"  7/1/95 

11/16/95 


4/15/95 
6/30/95 


11/15/95 
3/31/96 


4/1/96 


6/30/96 


Length 


1/31/93        6/30/93  181 


107 
108 

181 
184 

74 
76 


138 
137 

~9r 


Start  Stop 


Length 


7/1/93 


9/15/93 

77 

11/30/93 

76 

8/15/94 

258 

4/30/95 

258 

7/15/95 

76 

9/30/95 

77 

11/30/95 

61 

1/31/96 

62 

2/1/96  6/30/96 


151 


Total  Follow-up  per  city 


1400 


1552 


3)  Defining  the  sample 

A  typical  insurer's  cost  measure  is  the  Per  Member  Per  Month  rate.  However, 

this  measure  conflates  access  to  care  with  intensity  of  services,  as  either  measure  could 
vary  over  time  to  change  this  amount.  To  draw  distinctions  between  these  two  issues,  I 
propose  to  follow  all  client  costs,  and  periods  of  no  costs,  after  a  client  has  an  electronic 
record  opened  at  DMHAS.  This  cohort  definition  is  different  from  the  access  cohort,  in 
that  it  includes  people  who  received  DMHAS  treatment  prior  to  their  first  known  period 
of  GA  coverage,  and  people  who  received  treatment  before  the  start  of  the  follow-up 
period,  but  excludes  GA  clients  who  never  received  any  care.  In  Hartford,  3,441  people 
were  included  in  the  analysis,  and  in  New  Haven,  3,564  people. 
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4)  Covariates  of  interest 

The  available  covariates  that  may  affect  costs  are  identical  to  those  in  the  target 

efficiency  analysis.  Below  are  some  introductory  comments — these  variables  will  be 
explored  in  greater  detail  in  Chapter  6. 

a)  Socio-demographic  variables 

Socio-demographic  variables  become  more  important  in  this  follow-up  analysis, 

because  there  is  more  opportunity  for  subtle  bias  and  service  capacity  differences  to 
affect  the  patterns  of  the  many  types  of  care  aggregated  into  one  cost  measure. 

b)  GA  variables 

Available  GA  variables  are  also  similar  to  those  used  in  previous  analyses. 
However,  GA  status  at  treatment,  and  GA  enrollment,  will  be  handled  some  what 
differently  (see  below).  The  total  number  of  GA  episodes  remains  important  in  that  it 
indicates  the  number  of  insurance  transitions  a  client  made  over  time. 

c)  Diagnosis 

Unlike  previous  analyses,  this  analysis  contains  information  on  multiple 
diagnoses  over  time.  Primary  and  secondary  diagnostic  codes  from  each  treatment 
episode  were  categorized  as  previous  described.  The  process  of  identifying  MSA  clients 
was  repeated  over  each  DMHAS  clinical  episode,  so  that  any  primary  or  secondary  Axis 
1  diagnosis  and  any  primary  or  secondary  substance  abuse  diagnosis  in  any  episode  leads 
to  the  MISA  designation.  For  the  remaining  clients,  any  Axis  1  diagnosis  or  Substance 
abuse  diagnosis  was  similarly  retained  over  observations  with  an  Other  diagnosis  or  a 
missing  value.  Because  diagnosis  is  a  marker  for  both  severity  and  the  types  services  that 
the  GAP  is  supposed  to  manage,  I  expect  to  see  different  patterns  in  cost  change  for  each 
diagnostic  group. 
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5)  Modeling 

a)  Calculating  average  daily  costs  per  period 

Direct  costs  were  calculated  in  three  steps.  First,  each  individual  cost  was  labeled 

as  a  GA  cost  or  non  GA  cost,  depending  on  whether  it  occurred  during  an  episode  of  GA 

medical  coverage.  This  process  was  simple  for  individual  sessions  of  ambulatory  care, 

but  more  problematic  for  per  diem  services.  For  these  (inpatient  and  day  hospital  care) 

the  entire  per  diem  episode  was  assigned  to  one  funding  source  based  on  their  insurance 

status  on  the  first  day  of  admission.  Given  the  extremely  low  number  of  insurance  and 

period  transitions  in  relation  to  days  of  follow-up,  it  is  highly  unlikely  that  a  person 

would  have  lost  or  gained  insurance  coverage  during  a  per  diem  treatment  episode,  but 

even  if  they  did,  there  is  no  reason  to  assume  that  this  misclassification  of  costs  would 

favor  one  payment  source  over  another. 

Occupational,  vocational,  and  recreational  therapy  costs  were  ignored  because 
only  some  DMHAS  facilities  offer  them  and  others  must  always  refer  clients  to  outside 
providers.  Visits  by  case  managers  to  clients  while  they  are  hospitalized  were  also 
ignored,  because  these  visits  are  probably  affected  by  the  location  of  the  hospitalization 
in  relation  to  the  parent  LMHA,  and  not  all  LMHAs  provide  this  service  reliably. 

Second,  the  total  number  of  days  of  GA  coverage  within  a  policy  period  or 
Subperiod  were  summed,  and  the  total  GA  eligible  days  minus  the  covered  days  were 
designated  days  off  of  GA  coverage.  If  first  DMHAS  contact  occurred  after  the  follow- 
up  started,  both  of  these  values  were  left  censored  by  the  first  DMHAS  contact  date. 

Third,  for  each  period  or  Subperiod,  the  total  costs  per  insurance  status  were 
divided  by  the  days  of  follow-up  for  the  same  insurance  status,  yielding  an  average  daily 
cost  for  each  insurance  status  in  that  period.  If  there  were  no  follow-up  days,  the  cost 
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average  was  set  to  missing  (to  avoid  dividing  by  0).  Clients  with  average  daily  per  diem 
costs  higher  than  the  maximum  per  diem  rate  (because  the  per  diem  episode  may  have 
occurred  during  an  insurance  or  period  transition)  were  assigned  the  maximum  daily  per 
diem  cost. 

b)  Model  design 

These  average  daily  costs  per  period  serve  as  the  outcome  for  a  regression  where 
correlation  of  within  subject  variance  across  time  is  controlled  by  modeling  subjects  as  a 
random  effect.  However,  there  are  actually  two  cost  outcomes  within  each  time  period 
for  each  insurance  status,  leading  to  a  repeated  insurance  effect  nested  within  a  repeated 
time  effect.  Proc  Mixed  on  SAS  6.12  allows  for  multivariate  repeated  measures  by 
multiplying  the  repeated  measures  covariance  matrices  together  (Galecki,  1994).  All 
possible  combinations  of  covariance  structures  were  tried,  but  none  of  the  models  would 
converge.  Instead,  for  each  site,  one  model  for  each  insurance  status  was  fit,  and  a 
compound  symmetry  structure  was  chosen  to  model  the  variance  of  the  repeated  time 
measure.  The  compound  symmetry  structure  with  a  random  subject  effect  allows  for 
some  control  for  a  subject's  changing  severity,  in  that  costs  in  one  period  are  only 
assumed  to  be  related  to  the  costs  in  the  periods  directly  before  and  after  it13. 

These  models  include  differing  lengths  of  follow-up  across  both  periods,  and  by 
insurance  status  within  periods.  Therefore,  different  variances  in  raw  average  daily  costs 
are  given  the  same  weight  in  these  models.  This  error  is  both  non-differential  and 
unavoidable,  and  the  cost  estimates  themselves  are  valid. 


13  For  a  comparison  of  different  structures,  see  Jennrich  and  Schlucter,  1986. 
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c)  Collapsibility 

As  with  the  access  analysis,  I  tested  the  collapsibility  of  the  subperiods.  Granted, 
this  process  is  not  as  robust  as  in  the  prior  model  because  there  are  not  two  subperiods  for 
every  period.  However,  there  are  two  subperiods  for  most  full  periods  where  variation  is 
most  important,  during  the  GAP  itself.  To  explore  the  validity  of  collapsing,  total  direct 
costs  (sum  of  costs  while  on  and  off  GA  within  a  time  period)  were  modeled  by 
Subperiod.  Their  results  are  shown  in  the  figures  below.  Boxes  around  Subperiod  pairs 
indicate  that  the  pairs  are  to  be  collapsed. 
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Figure  4-5:  Hartford  costs  collapsibility  test 

Hartford  avereage  daily  costs  per  subperiod  with  95%  confindence  intervals 
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Figure  4-6:  New  Haven  costs  collapsibility  test 

New  Haven  average  daily  costs  per  subperiod  with  95%  confidence  intervals 
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In  these  two  graphs,  all  of  the  subperiods  designated  to  collapse  have  overlapping 
confidence  intervals,  indicating  that  it  is  appropriate  to  collapse  those  levels.  Model 
building  proceeded  with  7  time  periods,  and  on  GA  and  Off  GA  costs  were  model 
separately.  The  details  and  results  of  this  process,  including  comparisons  between 
insurance  statuses  and  across  sites,  are  discussed  in  the  Chapter  6. 

4.  Analysis  of  outcomes  by  racial  subgroups 

I  have  also  hypothesized  that  the  GAP  will  standardize  any  differentials  in  access 
to  care  or  utilization  among  minority  groups.  As  discussed  in  previous  sections,  some 
Race/Ethnicity  data  and  some  language  data  are  available  for  the  three  main  analyses.  If 
the  GAP  has  clear  effects  in  each  analysis,  it  seems  prudent  to  explore  if  these  effects 
vary  by  minority  group. 

More  specifically,  standardization  in  outcomes  across  minority  groups  will  occur 
if  there  were  minority  differences  in  pre-GAP  periods,  and  these  differences  were  smaller 
during  post-GAP  periods.  This  change  can  be  determined  by  fitting  Race  or  Language 
and  policy  period  interactions,  in  the  same  way  that  Period*  GA  status  interactions  will 
be  used  in  the  access  analyses  or  Period* diagnosis  interactions  in  the  cost  analyses.  As 
with  the  cost  analyses,  to  focus  on  the  GAP  effect,  separate  models  should  be  fit  for 
accessing  care  or  incurring  costs  while  GA  benefits  are  active,  and  while  they  are 
inactive. 

5.  Conclusions 

This  chapter  has  operationalized  the  evaluation  principles  developed  in  the 
literature  review  and  applied  them  to  the  three  GAP  sites.  The  next  chapter  describes 
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results  of  the  qualitative  organizational  study.  Chapter  6  presents  quantitative  findings  on 
client  level  analyses  of  the  Hartford  and  New  Haven  GAP  sites.  These  two  separate 
analyses  will  be  integrated  in  Chapter  7. 
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Chapter  5:  Qualitative  Analysis  and  Findings 

1.  Introduction 

Qualitative  data  collected  for  this  dissertation  provides  a  description  of  the 
Department  of  Mental  Health  and  Addiction  Services  (DMHAS)  General  Assistance  Pilot 
(GAP)  project,  and  aids  in  its  replication  and  generalization  to  other  communities.  Most 
of  this  description  was  presented  in  Chapter  3.  This  chapter  presents  analyses  of  the 
relative  merits  of  the  various  integration  strategies  employed  by  the  Bridgeport,  Hartford, 
and  New  Haven  GAP  sites,  and  also  comments  on  the  rigor  of  their  managed  care 
procedures. 

Each  GAP  site  used  the  same  techniques  to  coordinate  services  and  to  implement 
managed  care  in  a  fragmented  environment.  Analyses  of  the  qualitative  data  revealed 
themes  that  will  be  of  interest  to  planners  attempting  similar  interventions.  The  common 
GAP  problems  stem  from  the  integration  of  three  different  aspects  of  managed 
behavioral  health  care;  1)  integrating  mental  health  and  substance  abuse  services  for 
clients  with  comorbidities;  2)  integrating  clinical  and  welfare  agencies  and  disciplines; 
and  3)  integrating  a  managed  care  approach  of  controlling  costs  developed  in  the  private 
sector  into  the  public  sector. 

Most  GAP  clients  with  both  mental  health  and  substance  abuse  service  needs  are 
not  impaired  enough  or  have  the  appropriate  Axis  I  diagnosis  to  qualify  for  state  mental 
health  services  under  traditional  categorical  eligibility  groups.  Connecticut  Local  Mental 
Health  Authorities  (LMHAs)  have  little  experience  with  this  population.  Further,  much 
of  the  academic  research  on  clients  with  dual  diagnoses  (Drake,  McLaughlin,  Pepper  & 
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Minkoff,  1991)  has  been  on  clients  with  serious  mental  illness  (Axis  1  disorders),  and 
only  offer  indirect  guidance  on  how  to  integrate  mental  health  and  substance  abuse 
treatment  to  the  GAP  client's  advantage.  The  GAP  has  settled  some  of  the  bureaucratic 
aspects  of  this  dilemma  by  assigning  responsibility  for  the  GAP  to  LMHAs.  Though  this 
assignment  was  not  specifically  designed  to  change  the  LMHA  target  population,  it  does 
ask  an  LMHA  to  administer  a  program  for  a  client  pool  with  which  it  is  not  familiar. 
Further,  the  GAP  staff  themselves  must  determine  how  to  best  integrate  the  mental  health 
and  substance  abuse  treatment  paradigms. 

The  GAP  is  an  interagency  collaboration,  and  forces  the  integration  of  two 
different  organizations  as  well  as  two  different  professions.  Working  in  a  welfare  agency 
is  a  bureaucratic  exercise  to  distribute  funds  and  protect  against  system  abuse.  Too  much 
assistance  is  seen  as  disempowering  for  the  recipients,  and  offering  services  to  the 
ineligible  is  illegal  and  politically  unpopular.  In  contrast,  behavioral  health  does  not 
suffer  the  same  political  penalties  if  they  treat  people  who  do  not  need  services,  or 
provide  too  intense  services  -  though  this  leeway  is  diminishing  as  cost  pressure 
increases.  Merging  these  two  sets  of  providers  forces  these  different  styles  to  merge. 
With  it  comes  typical  interagency  rivalry  that  is  not  likely  to  be  discipline  specific  - 
conflict  over  space,  resources,  and  procedures,  and  welfare  staffs  fears  of  losing  their 
jobs  to  GAP  staff. 

These  two  organizational  issues  were  both  created  and  resolved  by  an 
interagency,  interdisciplinary  model.  This  chapter  will  qualitatively  explore  the  merits  of 
the  specific  mechanisms  used  that  the  literature  suggests  may  affect  the  success  of  the 
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collaboration.  These  are:  the  types  of  relationships  between  agency  managers,  other 
boundary  spanners,  and  line  staff;  collocation;  and  joint  training. 

The  final  integration  is  a  theoretical  one,  and  incorporates  managed  care 
techniques  pioneered  in  the  private  sector  into  to  the  public  sector  GAP.  The  GAP  sites 
implemented  their  primary  managed  care  mechanism,  utilization  management,  by 
adapting  traditional  public  sector  mental  health  financial  and  information  systems  and 
referring  clients  to  a  provider  pool  with  little  managed  care  experience.  The  procedural 
similarities  and  differences  in  the  three  sites'  utilization  management  models  suggest  that 
public  sector  versions  of  managed  care  are  predictably  different  from  private  sector 
versions. 

2.  Integration  methods 

The  GAP  programs  uses  three  primary  mechanisms  to  allow  different  agencies 
and  disciplines  to  work  together  harmoniously.  All  sites  rely  on  joint  management, 
collocation  and  joint  training  or  cross  training  to  varying  degrees.  Perhaps  as  a  result  of 
these  variations,  each  site  experiences  differing  degrees  of  inter-organizational  and  intra- 
organizational  conflict.  This  chapter  will  hypothesize  that  the  extent  of  the  conflict  is  a 
predictable  result  of  the  integration  methods  chosen  at  each  site. 

A.  Process  of  Integration 

Below,  I  will  summarize  and  contrast  specific  integration  techniques.  Though 

collocation  is  the  primary  integration  strategy,  joint  management  also  proved  essential  in 
getting  behavioral  health  and  welfare  agencies  to  cooperate  effectively. 
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1)  Joint  Management 

The  Bridgeport  site  relies  heavily  on  collocation  to  facilitate  a  strong  working 

relationship  between  the  GAP  and  the  Bridgeport  GA  office.  To  a  lesser  extent,  it  also 
relies  on  meetings  between  staff  at  various  levels,  but  these  seem  more  ad  hoc  and  less 
formal,  compared  to  New  Haven's  and  Hartford's  interagency  committees.  The 
Bridgeport  GAP  Director  and  former  GA  Director  claimed  to  have  an  excellent  working 
relationship.  Welfare  managers  meet  with  the  GAP  Director  and  staff  as  needed,  and 
caseworkers  from  both  agencies  speak  as  needed  about  client  issues.  However,  the 
frequency  and  the  nature  of  informal  contact  seem  to  have  changed  in  response  to 
changes  in  collocation.  (These  changes  will  be  discussed  in  later  sections.) 

The  Hartford  GAP  benefits  from  close  proximity  to  the  city  welfare  office 
(adjacent  buildings  on  the  same  campus)  which  has  facilitated  informal  contact  on  the 
supervisory  level.  The  Clinical  Director  and  the  primary  Caseworker  Supervisor  (the  line 
staff  supervisor)  see  each  other  frequently.  The  City  GA  director  and  LMHA  director 
meet  a  few  times  a  year  about  the  GAP. 

New  Haven,  which  also  has  a  community  health  center,  the  Hill  Health 
Corporation  (HHC)  sponsoring  the  GAP,  manages  joint  governance  through  an  Executive 
Committee,  comprised  of  the  city  GA  director,  the  HHC  GA  division  head  and  the 
LMHA  Associate  Director.  Most  decisions  are  made  by  a  Steering  committee  that  meets 
monthly  at  the  LMHA,  and  is  open  to  any  staff  member  though  it  is  primarily  attended 
LMHA  employees.  Managing  by  interagency  committee  is  confusing,  and  New  Haven 
has  had  difficulty  in  sharing  information  within  the  GAP  and  in  coordinating  clinical 
services. 
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2)  Collocation 

Collocation,  or  physically  locating  GAP  staff  in  welfare  offices,  is  used  by  all 
sites  to  some  extent.  Collocation  horizontally  integrates  services  from  the  clients 
perspective,  as  the  client  can  see  both  sets  of  providers  in  one  building  at  one  time,  and 
has  as  the  added  advantage  of  facilitating  informal  contact  and  information  exchange 
between  agencies.  This  integration  also  results  in  the  increased  distance  between  a  GAP 
and  its  host  LMHA,  and  the  benefits  of  collocation  afforded  to  different  agencies  seem  to 
be  matched  by  less  interaction  with  home  agency  staff.  Below,  the  extent  of  collocation 
is  briefly  summarized. 

The  Bridgeport  GAP  is  a  division  of  the  Bridgeport  LMHA,  with  no  permanent 
office  space  in  the  LMHA  proper.  Initially,  the  entire  GAP  staff  (about  20)  were  located 
at  the  GA  city  offices.  In  April  1995,  the  Bridgeport  GAP  moved  to  a  satellite  office  a 
few  blocks  away  from  the  city  welfare  office,  leaving  only  a  6  person  assessment  unit  at 
the  welfare  office  for  screenings,  and  greatly  relieving  staff  crowding  in  the  welfare 
building.  This  may  have  affected  relationships  with  the  LMHA,  because  unlike  the  other 
sites  (and  even  other  divisions  of  the  Bridgeport  LMHA),  this  pilot  has  no  office  space 
within  the  LMHA  proper,  and  since  the  intensity  of  this  collocation  was  greater  than  the 
other  sites,  it  also  may  have  affected  relations  with  the  GA  office. 

The  Hartford  GAP  is  a  division  of  the  Hartford  LMHA,  and  most  of  its  staff  are 
permanently  housed  at  the  LMHA.  It  also  has  3  case  managers,  2  assessment  workers 
and  1  secretary  stationed  in  offices  at  the  city  welfare  building. 

The  New  Haven  GAP  is  not  a  true  division  of  the  LMHA  and  is  run  by  an 
Executive  Committee.  The  LMHA  staff  supervisor  is  the  agency's  Associate  Director. 
The  Utilization  management  staff  for  the  New  Haven  GAP  (a  utilization  management 
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nurse  and  an  administrative  assistant,  who  are  both  HHC  employees)  are  placed  full  time 
at  the  city  welfare  office.  Two  to  four  LMHA  caseworkers  are  also  usually  on  site  at 
permanent  office  space  in  city  welfare.  They  work  full  time  for  the  LMHA  and  spend  at 
least  a  few  hours  a  week  at  their  home  LMHA  divisions. 

B.  Inter-organizational  conflict 

These  various  strategies  have  affected  day  to  day  operations  of  the  GAP  sites. 

Though  it  may  be  difficult  to  translate  these  effects  into  quantitative  clinical  or  fiscal 
measures,  this  section  will  describe  how  the  integration  mechanisms  qualitatively 
affected  inter-organizational  and  interdisciplinary  relationships.  The  GAP  forced 
cooperation  of  two  agencies  (and  in  New  Haven,  three)  from  different  disciplines  —  that 
of  behavioral  health  clinicians  and  the  welfare  providers.  This  disciplinary  conflict  is 
part  of  the  organizational  tensions  between  the  GAP  sites  and  the  welfare  offices. 
Among  the  three  sites  evaluated,  Bridgeport  had  the  most  intense  collocation,  and 
Hartford  the  least  intense. 

Negative  effects  of  collocation  are  summarized  under  the  term  "tension",  which  is 
not  a  specific  measure,  but  rather  a  conceptual  theme  created  to  categorize  many  of  the 
negative  interactions,  conflicts,  and  hostility  reported  to  me  by  key  informants. 
"Collaboration"  is  the  opposite  sort  of  conceptual  theme,  and  represents  the  positive 
aspects  of  integration,  such  as  information  sharing,  enhanced  service  coordination,  and 
mutual  staff  support.  These  themes  are  not  mutually  exclusive—  staff  from  different 
agencies  could  dislike  each  other  intensely  and  still  work  effectively  together  to  help 
clients. 
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1)  Bridgeport 

The  initial  phase  of  collocation  caused  tension  between  the  Bridgeport  welfare 
office  and  the  Bridgeport  GAP.  Both  groups  of  interviewees,  but  especially  the  GA  staff, 
reported  "territorial  behavior"-  competitiveness,  resentment  and  anxiety  on  the  part  of 
the  GA  staff  about  fear  of  losing  their  jobs.  As  one  subject  put  it,  the  GAP  staff  took 
over  half  of  the  GA  offices,  displacing  some  City  staff  who  had  been  there  for  years,  and 
forcing  all  City  staff  to  share  break  rooms,  etc.  with  "outsiders"  who  took  their  space  and 
may  soon  take  their  jobs. 

However,  once  the  adjustment  phase  was  over,  the  intense  collocation,  according 
to  Bridgeport  GAP  managers,  encouraged  informal  and  frequent  interaction  between 
GAP  and  City  GA  staff.  This  process  was  helped  by  training  sessions  for  the  GA  staff 
on  clinical  issues  and  screening.  Though  the  collocation  did  create  overcrowding  and 
some  resentment  between  line  staff  (though  not  open  conflict),  both  groups  were  able  to 
adapt  to  each  other's  style  and  work  together. 

In  April  1995,  most  of  the  GAP  staff  moved  to  their  satellite  office,  leaving 
behind  only  a  6  person  assessment  and  intake  unit  in  the  city  welfare  building.  This 
smaller  group  is  on  the  same  floor  but  separated  by  a  hallway,  as  and  one  GA  staff 
member  put  it,  this  GAP  arrangement  is  less  "intrusive",  and  GA  staff  feel  as  if  they 
"have  their  old  office  back".  The  GAP  staff  also  had  felt  very  cramped  in  their  original 
space  as  well,  and  seem  universally  pleased  with  their  new  satellite  office.  After  the 
move,  most  of  the  informal  interaction  between  city  and  Pilot  caseworkers  about  clients 
has  been  replaced  with  forms  that  are  faxed  back  and  forth  from  the  satellite  to  the 
welfare  office,  though  no  informant  complained  about  any  reduction  in  ability  to 
coordinate  client  services.  The  remaining  GAP  presence  at  GA  offices  seems  to  be 
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highly  valued  by  all  informants,  and  both  sides  credit  the  collocation  of  the  intake  and 
assessment  unit  with  what  they  claim  is  a  low  loss  to  follow-up  rate  of  their  clients. 
Clients  are  escorted  down  the  hall  immediately  after  GA  intake,  and  if  the  client  appears 
unstable  or  disturbed,  the  GA  caseworkers  feel  comforted  that  they  can  rely  on  the  GAP 
staff  nearby  for  advice  and  assistance. 

2)  Hartford 

The  Hartford  GAP  has  relied  less  on  collocation  and  more  on  training  than  the 
other  sites.  GAP  staff  have  run  several  formal  training  sessions  with  city  welfare  staff 
that  they  claim  have  done  much  to  improve  the  working  relationship  between  the  two 
agencies.  Initially,  during  preliminary  interviews  in  1994,  the  Pilot  staff  reported  city 
welfare  line  staff  were  somewhat  threatened  and  defensive  about  "state  workers"  getting 
involved  in  the  care  of  GA  clients.  Probably  more  indicative  of  a  professional  discipline 
dispute  than  an  agency  conflict,  both  GAP  and  city  welfare  managers  reported  GAP  staff 
seemed  to  think  they  were  "better  trained"  and  more  qualified  to  deal  with  the  GA  clients, 
and  city  welfare  staff  seemed  to  think  LMHA  staff  were  "arrogant  and  inflexible". 
Training  not  only  helped  city  staff  deal  with  some  technical  issues,  become  familiar  with 
Pilot  and  client  referral  procedures,  but  may  have  also  help  relieve  this  tension. 

However,  one  City  GA  manager  claimed  that  the  most  likely  way  they  diffused 
this  tension  was  by  collocating  some  GAP  staff  at  the  city  welfare  building  in  one  of  the 
units,  which  gave  staff  the  chance  to  get  to  know  one  another  on  a  more  personal  level. 
For  example,  the  GAP  Clinical  Director  has  a  very  hands-on  style  and  spends  quite  a  bit 
of  time  at  the  GA  building  with  clients.  She  has  developed  a  strong  relationship  with  the 
GA  staff  and  has  even  helped  the  GA  staff  themselves  with  personal  problems. 


146 


Both  the  Hartford  GAP  leadership  and  the  GA  leadership  reported  that  training 
and  collocation  has  improved  the  working  dynamics  of  these  two  agencies.  Further,  GAP 
staff  can  remain  an  important  resource  to  GA  workers  without  being  collocated,  because 
the  welfare  office  and  the  LMHA  are  only  a  few  hundred  yards  apart.  However,  informal 
inter-agency  relations  seem  to  be  the  worst  in  Hartford  out  of  the  three  sites.  As  one 
welfare  interviewee  put  it,  "the  management  and  the  executives  see  eye  to  eye"  on  most 
issues  but  the  line  staff  have  had  difficulties  in  working  together.  Executive  meetings 
have  been  helpful,  but  they  may  "not  be  grounded  in  operational  terms". 

Informants  seem  to  agree  that  they  cannot  attribute  any  concrete  success-  e.g. 
increased  referrals  or  increased  accuracy  of  referrals  -  to  integration  initiatives.  All 
Hartford  interviewees  except  the  utilization  management  nurse,  who  wasn't  asked, 
complained  about  poor  referral  rates.  They  seemed  to  blame  earlier  rates  on  interagency 
hostility  (at  first)  then  poor  clinical  sophistication  of  the  GA  staff  (intermediate  phase) 
and  later  seemed  to  blame  it  on  poor  morale  of  city  staff  due  to  impending  layoffs  when 
the  DSS  takes  over  Hartford  GA.  Bridgeport  and  New  Haven  have  also  voiced  these 
complaints  about  interagency  relations,  staff  training,  and  low  morale,  but  did  not  feel 
their  referral  rates  were  unnecessarily  low. 

Interestingly,  I  use  the  term  'referral  rate'  because  that  is  the  term  used  by  all 
DMHAS  and  DSS  staff.  However,  neither  agency  was  able  to  match  up  the  number  of 
GA  enrollees  with  the  number  of  clients  being  screened.  Lacking  a  denominator,  they 
really  meant  'number  of  clients  referred'. 
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3)  New  Haven 

As  one  New  Haven  informant  said,  "collocation  is  not  a  magic  bullet"  and  it 
resulted  in  some  problems  between  GAP  and  welfare  staff  beyond  the  agency  level  turf 
issues  discussed  elsewhere.  GAP  staff  were  initially  seen  as  outsiders,  and  not  well 
received.  LMHA  and  Hill  Health  Center  (HHC)  staff  took  welfare  office  space  and  had 
much  better  equipment,  office  supplies,  etc.,  which  may  have  lead  to  some  jealousy.  The 
pilot  itself  was  seen  as  threatening  to  City  GA  staff  who  feared  for  their  jobs  (especially 
since  there  was  talk  of  privatizing  city  welfare  during  early  1995). 

These  problems  were  minimized  over  time  by  the  increased  formal  and  informal 
contact  brought  on  by  collocation  and  joint  training.  Formal  joint  retreats  and  periodic 
in-services  by  GAP  staff  (usually  run  by  HHC  staff  at  city  welfare  staff  meetings)  helped 
reassure  GA  staff  that  they  would  not  lose  their  jobs,  as  well  as  explain  ways  in  which 
GAP  staff  could  be  a  resource  for  them,  and  teach  them  about  running  the  pilot  and 
referring  clients.  Informal  contact  was  also  important.  For  example,  one  HHC  employee 
told  me  that  she  "made  friends"  with  the  City  staff  by  giving  them  file  folders,  office 
supplies,  and  the  like.  More  significantly,  due  to  the  crisis  nature  of  working  with  GA 
clients,  one  GA  manager  reported  that  her  staff  could  rely  on  GAP  staff  for  impromptu 
advice. 

4)  Synthesis  of  findings  on  inter-organizational  conflict 

Collocation  and  joint  training  helped  GAP  and  welfare  agencies  work  together. 

Across  these  three  sites,  as  shown  in  Figure  1 ,  tension  and  collaboration  has  followed  a 
similar  pattern.  Further,  the  intensity  of  this  pattern  (both  in  the  extremes  of 
collaboration  and  tension)  was  proportional  with  the  intensity  of  the  collocation.  The 
GAP  began  as  a  formal  collaborative  planning  process  at  each  site  where  agencies  began 
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to  negotiate  structure  and  agreements.  Tension,  as  described  above,  reached  its  peak 
soon  after  GAP  staff  moved  into  welfare  offices.  All  sites  reported  this  tension  subsided 
as  staff  got  to  know  one  another  on  an  informal  basis  through  proximity  and  joint 
training.  At  the  same  time,  referral  practices  were  introduced,  improving  service 
coordination  for  clients.  After  some  indeterminate  transition  period,  tension  seems  to 
have  subsided,  and  collocation  and  training  do  seem  to  encourage  a  strong  collaborative 
atmosphere  that  leads  to  appropriate  client  referral  to  the  GAP  assessment  workers,  and  a 
great  deal  of  information  sharing  about  clients.  Interestingly,  as  one  clinical  director 
speculated,  training  in  itself,  which  gives  staff  the  chance  to  get  to  know  one  another  and 
reassert  the  GAP  goals,  may  be  more  important  than  the  specific  content  of  the  training. 

Figure  5-1:  Theorized  Interagency  Collocation  Effects  Over  Time 


Tension 


The  key  informant  interviews  occurred  during  this  mature  phase.  At  this  time, 
welfare  staff  morale  in  all  the  sites  was  very  low.  DSS  was  threatening  to  take  over  city 
operations  and  possibly  lay  off  most  of  its  staff  (it  did  so  April  1,  1997,  after  the  study 
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period).  This  pressure  was  in  addition  to  the  long  term  problems  reported  by  GA 
managers  in  all  sites.  They  have  case  loads  many  times  that  of  GAP  staff,  lower  pay, 
and  often  have  difficulty  obtaining  supplies.  Further,  though  current  GA  standards 
require  college  educated  caseworkers,  many  staff  were  hired  before  those  standards  were 
in  place  and  lack  college  degrees.  One  GA  informant  I  spoke  with  broke  into  tears  of 
frustration  when  she  discussed  the  difficulties  in  keeping  her  staff  focused  and  motivated. 
When  I  interviewed  GA  managers  and  directors,  despite  all  the  hard  work  involved  in  the 
Pilot,  they  seemed  to  welcome  the  help  GAP  staff  brought  to  the  program.  One  went  so 
far  as  to  tell  me  they  hoped  the  GAP  staffs'  "professional  standards"  would  somehow 
improve  the  culture  of  their  GA  operations.  All  GAP  staff  I  have  spoken  with  felt 
collocation  was  necessary  to  ensure  collaboration  and  smooth  client  flow. 

C.  Infra-organizational  relations 

GAP  intra-organizational  relationships  are  highlighted  by  two  related  but  distinct 

aspects  of  the  GAP  models  that  will  be  described  below.  First  are  tensions  between  the 
GAP  and  its  parent  LMHA.  These  seem  to  stem  from  differences  in  GAP  and  LMHA 
target  populations,  but  can  be  minimized  by  the  degree  of  contact  with  the  GAP  and  its 
host  LMHA.  Related  to  GAP-  LMHA  tensions  are  tensions  which  stem  from  different 
treatment  models  within  the  GAP  as  to  how  best  to  treat  welfare  clients.  These  discipline 
conflicts  were  most  apparent  in  Hartford.  New  Haven's  unique  model  brought  on  a  host 
of  principal  agent  conflicts  and  communication  problems,  but  minimized  tensions 
surrounding  target  populations  and  disciplines  by  adopting  a  simpler  case  management 
model  as  the  primary  GAP  service. 
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1)  Bridgeport 

The  Bridgeport  GAP  remains  the  most  highly  collocated  GAP  of  the  three,  at  first 
being  almost  entirely  located  in  the  Welfare  building,  and  now  mostly  located  at  a 
satellite  clinic.  For  all  of  its  existence,  the  Bridgeport  GAP  has  also  been  the  most 
physically  separated  from  its  LMHA,  and  its  relationship  with  its  parent  LMHA  seems  at 
times  to  be  strained.  Unlike  the  LMHAs  at  the  other  cities,  the  Bridgeport  LMHA  does 
not  include  clients  with  personality  disorders  in  its  target  population  definition,  thereby 
excluding  most  GAP  clients.  The  GAP  feels  it  does  not  get  much  clinical  support,  and 
from  my  own  cross  site  observations,  it  gets  the  least  clinical  support  of  the  three  GAP 
sites.  For  example,  while  the  Bridgeport  GAP  does  all  its  GA  crisis  evaluation  and  home 
visits  during  the  day,  the  Hartford  LMHA  mobile  crisis  team  will  occasionally  provide 
coverage  to  the  Hartford  GAP.  From  the  perspective  of  Bridgeport  GAP  staff,  the 
LMHA  does  not  often  treat  GAP  clients,  and  I  have  heard  complaints  (which  due  to  the 
informal  nature  of  the  internal  referral  process  cannot  be  confirmed  or  denied)  that  the 
LMHA  occasionally  has  been  resistant  to  taking  GAP  clients. 

There  are  no  obvious  causes  for  this  reported  difficulty  in  securing  LMHA 
services  for  GA  clients,  and  these  reports  are  the  most  serious  of  intra-agency  tensions 
reported  by  the  three  GAPs.  It  is  unclear  that  Bridgeport's  alleged  difficulties  stem  from 
its  lack  of  political  power  within  the  LMHA.  It  was  able  to  secure  comfortable  space  in 
its  satellite  office.  However,  the  LMHA  Director  does  not  seem  to  play  a  major  role  in 
GAP  -  external  agency  relations  (including  the  city  welfare  agency),  where  as  the 
Hartford  LMHA  Director  does,  and  the  New  Haven  GAP  is  partially  supervised  by  the 
LMHA  Associate  Director.  Such  high  level  attention  would  obviously  help  smooth  intra- 
organization  relations,  and  though  Hartford  informants  never  spoke  of  the  need  for  it,  one 
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senior  New  Haven  informant  claimed  high  level  internal  oversight  is  necessary  to 
coordinate  efforts  across  divisions. 

LMHA  stigma  against  welfare  clients  is  also  a  possible  explanation.  Negative 
stereotypes  by  clinicians  for  the  seriously  mentally  ill  (Brown,  1989)  against  welfare 
clients  portray  them  as  less  needy  than  clients  with  serious  mental  illness,  or  less 
deserving  because  substance  abuse  and  poverty  have  a  more  behavioral  component  than 
serious  mental  illness. 

Finally,  this  tension  may  simply  stem  from  differences  in  availability  of  resources 
across  sites.  As  a  GAP  manager  explained  to  me,  the  Bridgeport  LMHA  is  particularly 
overwhelmed,  because  unlike  the  Hartford  site,  they  have  an  inpatient  unit  which  draws 
enormous  resources,  and  unlike  New  Haven,  they  do  not  have  the  trainees  and  other 
"resources  of  Yale"  to  back  them  up  (referring  to  the  New  Haven  LMHAs  dual 
governance  and  staffing  structures  as  a  collaboration  between  DMHAS  and  the  Yale 
School  of  Medicine's  Department  of  Psychiatry). 

Bridgeport  informants  also  reported  that  GA  clients  may  stigmatize  the  LMHA 
and  its  traditional  target  population.  Two  senior  informants  claimed  that  at  the  start  of 
the  pilot,  GA  clients  did  not  want  to  receive  mental  health  treatment,  counseling,  or 
substance  abuse  services  from  LMHA  (non-GAP  )  staff,  not  only  because  the  Bridgeport 
LMHA  is  far  from  downtown,  but  that  it  is  perceived  as  the  treatment  provider  for  the 
"crazies"  in  Bridgeport.  These  informants  claim  client  perception  has  changed  over  time, 
and  some  GAP  staff  think  this  is  because  GA  clients  receiving  mandatory  services  from 
the  GAP  spoke  favorably  of  the  program  to  reduce  their  peers'  stigma  of  the  GAP. 
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Services  offered  by  the  Bridgeport  GAP  may  have  escaped  their  client's  stigma 
due  to  its  collocation  with  welfare.  This  comfort  with  GAP  clinicians  is  important  due  to 
the  GAP's  reliance  on  self  referral  for  treatment  needs,  and  difficulty  in  keeping  clients 
engaged  in  treatment.  Clients  had  all  of  their  contact  with  GAP  staff  at  the  welfare 
offices  during  the  first  year  of  the  Pilot  when  the  GAP  was  entirely  collocated  at  the 
Welfare  building.  To  clients,  getting  mental  health  screening  and  counseling  was  not 
very  different  from  getting  employment  assistance.  One  Bridgeport  GAP  manager  thinks 
clients  were  happier  to  receive  services  at  the  satellite  office  than  they  were  at  the  GAP 
offices  in  the  city  welfare  building.  Unlike  the  welfare  office,  the  satellite  office  is  well 
lit,  clean,  and  has  no  armed  guards  or  cinder  block  walls.  The  building  resembles  more 
of  a  clinic  than  a  welfare  office.  One  GAP  informant  noted  how  friendly  the  clients  are 
with  each  other  and  with  the  staff,  and  says  the  atmosphere  can  best  be  described  as  a 
"Saturday  church  social". 

2)  Hartford 

The  Hartford  GAP  has  the  strongest  physical  link  to  its  LMHA,  and  of  all  the 
GAPs,  seems  to  have  the  highest  level  of  coverage  from  its  LMHA.  Further,  the  LMHA 
director  plays  a  direct  role  managing  the  strategic  relations  of  the  GAP  with  the  city 
welfare  office. 

The  main  intra-organizational  issues  at  the  Hartford  GAP  appear  to  be  over 
professional  disciplines,  between  mental  health  and  substance  abuse  clinicians' 
willingness  to  let  clients  suffer  the  negative  consequences  of  their  errors.  Everyone 
interviewed  from  Hartford  acknowledged  GAP  staffs  rigid  clinical  approaches  stemming 
from  their  serious  mental  illness  treatment  model.  Most  of  the  GAP  staff  has  primarily 
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mental  health  training,  and  had  some  trouble  adapting  to  a  different  client  population  and 
the  ability  to  suspend  GA  cash  benefits  for  treatment  non-compliance  (this  reluctance  to 
suspend  benefits  has  been  overcome  through  training,  though  it  is  still  rarely  used).  For 
example,  it  reportedly  was  very  hard  to  get  mental  health  staff  accustomed  to  the  notion 
of  brief  treatment. 

This  rigidity  was  overcome  through  training  and  close  supervision,  which  would 
not  have  been  possible,  claimed  the  trainer,  unless  senior  GAP  staff  were  familiar  with 
both  mental  health  and  substance  abuse  treatment  paradigms.  The  program  is  not  as 
successful  when  the  clinical  issues  are  complex.  All  the  Hartford  staff  interviewed  feel 
current  treatment  models  do  not  adequately  conceptualize  client  needs14.  Dual  diagnosed 
clients  remain  poorly  served  by  the  GAP,  according  to  one  city  welfare  employee,  not 
only  because  service  are  fragmented,  but  because  treatment  models  are  fragmented  as 
well.  Clients  with  "tri-diagnoses",  psychiatric,  substance  abuse  and  physical  health 
problems,  (such  as  HIV  or  TB)  are  even  more  difficult  to  treat.  Solving  these 
interdisciplinary  problems  seems  beyond  the  scope  of  an  interagency  managed  care 
program,  but  the  design  of  the  GAP  guarantees  these  issues  will  arise,  as  they  have  in 
each  site.  A  few  people  in  the  other  sites  mentioned  these  problems,  but  Hartford 
interviewees  spoke  of  them  often. 


14  This  training  issue  has  crossed  agency  barriers  as  well.  Hartford  GA  caseworkers  deal  with  clients 
without  medication  when  they  are  often  intoxicated,  and  claim  their  informal  experience  in  dealing  with 
these  "unprocessed"  clients  gives  them  some  skills  that  the  Hartford  GAP  clinicians  do  not  have.  In 
contrast,  GAP  staff  claim  that  they  are  better  trained,  more  professional,  and  better  able  to  meet  the  needs 
of  GA  clients.  The  Clinical  Director  does  some  assessments  herself  if  she  feels  that  with  some  of  the  GA 
clients'  florid  symptoms,  intoxication  may  lead  to  violence.  Apparently  there  have  been  some  problems  in 
the  past  with  GA  clients--  clients  see  little  distinction  between  pilot  staff  and  welfare  staff,  and  can  direct 
hostility  to  the  pilot  staff  that  in  other  sites  they  usually  direct  exclusively  to  welfare  staff.  Its  unclear  how 
to  interpret  this:  It  could  mean  that  the  Hartford  GAP  and  Welfare  offices  are  more  integrated  than  the 
other  sites  and  clients  see  little  difference  between  the  two  provider  groups;  or  that  Hartford  GAP  clinicians 
are  less  skilled  or  more  uncomfortable  around  clients  than  clinicians  from  other  sites.  Given  Hartford's 
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3)  New  Haven 

The  New  Haven  LMHA  chose  an  inter-division  model  because  of  its  flexibility 
in  dealing  with  an  initially  unpredictable  client  load.  Further,  they  wanted  to  integrate 
expertise  in  dealing  with  this  population  across  parts  of  the  LMHA.  The  LMHA 
Associate  Director  calls  this  strategy  "multiple  subordination".  This  version  of  the  GAP 
demands  a  GAP  director  at  the  LMHA  so  highly  placed  to  coordinate  efforts  across 
divisions  with  independent  clinical  structures,  and  indeed,  I  heard  few  complaints  from 
GAP  staff  about  other  parts  of  the  LMHA.  However,  he  cannot  spend  as  much  time  on 
the  GAP  as  his  full  time  GAP  director  counterparts  in  other  sites  -  he  reported  he 
spends  2-6  hours  per  week  on  GAP  business,  where  other  sites  have  full  time  directors. 

Clinical  care  at  the  New  Haven  GAP  has  avoided  most  of  the  intra-organizational 
tensions  found  in  the  other  GAPs,  for  several  reasons.  First,  the  New  Haven  GAP  pulls 
LMHA  staff  from  several  divisions,  some  of  which  serve  a  primarily  psychiatrically 
disabled  population  and  others  that  serve  a  primarily  substance  abusing  population. 
Second,  the  New  Haven  GAP  relies  on  a  less  ambitious  assessment  and  referral  role  for 
GAP  staff,  with  no  GAP  specific  treatment  groups,  thereby  leaving  more  control  for  non- 
GAP  clinicians. 

Since  the  LMHA  and  HHC  jointly  govern  the  GAP,  their  difficulties  are  viewed 
as  intra-organizational  problems  here,  as  opposed  to  inter-organizational  problems,  which 
occur  between  the  pilot  host  clinical  agencies  and  the  welfare  agency.  This  joint 
governance  also  placed  obligations  on  the  LMHA  to  meet  the  needs  of  the  HHC,  and  thus 
created  principal  agent  conflicts  between  the  State  mental  health  authority  and  the 
LMHA. 

preoccupation  with  training,  and  its  lack  of  collocation  with  the  GA  office,  GAP  clinician  discomfort  with 
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Perhaps  because  of  HHC's  more  activist  political  role  in  the  city,  or  because  it  had 
been  managing  physical  health  care  for  the  New  Haven  GA  for  several  years  before  the 
implementation  of  the  GAP,  the  HHC  played  a  major  role  in  the  provision  of  behavioral 
health  care  service  to  GA  clients  before  the  creation  of  the  pilot  -  a  role  not  played  by 
community  health  centers  in  the  other  sites. 

The  LMHA  is  unique  in  the  state  in  that  it  is  jointly  owned  and  operated  by  the 
State  and  the  Yale  School  of  Medicine's  Department  of  Psychiatry.  It  has  a  much  heavier 
portion  of  trainee  staff  (Psychiatric  residents,  social  worker  trainees,  etc.)  than  the  other 
LMHAs,  (which  may  have  lead  GAP  informants  at  other  sites  to  feel  it  has  more 
resources),  and  has  an  active  research  agenda.  A  combination  of  its  dual  governance  and 
its  three  part  mission,  of  clinical  care,  research,  and  education,  has  led  to  many  conflicts 
with  DMHAS.  DMHAS  leadership  during  the  Weiker  and  Rowland  Administrations  see 
it  as  one  of  the  less  progressive  LMHAs  in  pushing  a  community  based  care  agenda. 
This  perception  may  be  shared  by  HHC  leadership  as  well.  One  HHC  manager  felt  they 
had  a  greater  legitimacy  in  designing  behavioral  health  service  provision  for  GA  clients 
because  they  have  a  community  board  of  directors,  whereas  the  LMHAs  community 
board  has  only  advisory  status. 

Regardless  of  these  underlying  issues,  the  GAP  model  was  not  designed  with 
New  Haven  political  realities  in  mind.  The  introduction  of  the  GAP  into  New  Haven 
through  the  LMHA  initially  caused  a  great  deal  of  opposition  from  HHC  and  City 
Welfare.  When  DMHAS  declared  that  the  New  Haven  LMHA  would  be  responsible  for 
managed  mental  health  services  for  GA  clients,  HHC  and  the  New  Haven  City  Welfare 
office  were  offended  --  as  one  HHC  manager  put  it,  "before  Yale  [the  New  Haven 

some  of  their  own  clients  seems  more  likely. 
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LMHA]  became  involved,  it  was  as  if  the  problem  and  the  other  providers  had  never 
existed".  Therefore,  the  program  name  was  changed  to  the  "New  Haven  City  Welfare 
Behavioral  Managed  Care  Initiative".  More  substantively,  the  GAP  focus  at  this  site  wa 
re-oriented  to  substance  abuse  care  to  maintain  and  expand  on  the  existing  mental  health 
HHC-LMHA  referral  practice. 

Unfortunately  for  the  generalizability  of  this  version  of  the  GAP  model,  the  New 
Haven  GAP  executive  committee  members  independently  claimed  to  me  that  part  of  the 
success  of  the  collaboration,  and  their  ability  to  work  through  the  initial  turf  conflicts 
surrounding  program  implementation,  was  due  to  their  personalities  and  professionalism. 
However,  it  seems  likely  that  DMHAS  funds  for  the  program,  and  not  the  legislative 
mandate  on  the  LMHA,  was  the  strongest  motivation  for  these  agencies  to  collaborate  to 
such  a  degree,  as  was  suggested  by  other  organizational  theorists  (e.g.  Morrissey,  Tausig 
&  Lindsey,  1985;  Van  de  Ven  and  Walker,  1984).  Further,  the  HHC  center  manager  had 
been  working  directly  with  leadership  from  the  LMHA  and  from  City  Welfare  for  several 
years  before  the  start  of  the  Pilot,  and  as  predicted  in  the  literature  (e.g.  Aldrich,  1977; 
Beatrice,  1990;  Clayton,  1992),  this  existing  productive  relationship  proved  a  good 
starting  ground  for  more  intensive  collaboration. 

Tensions  between  state  mandates  and  the  unique  New  Haven  situation  has  been 
an  ongoing  problem.  HHC  is  a  large  and  well  established  clinical  facility  with  its  own 
regulations  and  policies  that  do  not  always  mesh  with  DMHAS  state  wide  attempts  at 
standardization  (e.g.  form  changes).  Though  some  LMHA  informants  complained  about 
this  Central  Office  oversight  during  their  interviews,  HHC  informants  feel  that  the 
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LMHA  does  not  always  adequately  protect  the  New  Haven  site  from  the  State's  efforts  to 
standardize  practices  across  GAP  sites. 

Different  procedures  across  New  Haven  agencies  has  also  caused  administrative 
inefficiency,  and  poor  information  sharing  between  the  substance  abuse  treatment  portion 
being  run  by  HHC  and  the  mental  health  treatment  side  provided  by  LMHA  staff.  Much 
of  this  fragmentation  stems  from  an  interagency  partnership  model  that  lacks  one  person 
with  true  authority.  There  is  no  clear  day  to  day  supervisor  of  the  entire  GAP,  and 
individual  staff  and  clinicians  enjoy  considerable  discretion  in  how  they  practice. 

Interestingly,  some  of  these  problems  may  also  stem  from  interdisciplinary 
tensions.  Due  to  differing  laws  regarding  mental  health  and  substance  abuse  clinical 
information,  HHC  and  the  LMHA  cannot  share  complete  medical  records  about  clients 
they  both  treat  without  signed  consent15.  Initially,  the  bifurcated  information  and  record 
systems  between  HHC  and  the  LMHA  was  not  much  of  a  concern,  since  HHC  was 
supposed  to  deal  with  substance  abuse  clients  and  the  LMHA  was  supposed  to  deal  with 
clients  with  mental  health  needs.  After  18  months  to  two  years  of  operation,  some  GAP 
clinicians  began  to  suspect  that  there  was  a  fair  amount  of  overlap  between  client  pools, 
but  due  to  the  lack  of  client  consent,  it  is  difficult  to  confirm  or  coordinate  mental  health 
and  substance  abuse  services  across  agencies.  One  informant  claimed  that  the  GAP  client 
pool  is  predominantly  one  population  with  both  service  needs,  and  both  agencies  are 
serving  the  same  set  of  clients,  but  don't  really  know  it. 

15  Designing  this  consent  form  is  a  good  example  of  how  joint  governance  and  a  lack  of  a  day  a  to  day 
supervisor  can  lead  to  inefficiency.  Such  a  consent  form  is  fairly  complicated,  and  must  comply  with 
Federal  and  State  regulations,  and  meet  the  approval  of  the  Steering  Committee,  HHC,  the  LMHA,  and 
raise  no  objection  from  the  State  Attorney  General's  Office  and  the  Yale  Medical  School  Counsel.  Though 
this  issue  had  appeared  before  the  Steering  Committee  for  almost  two  years,  no  one  took  responsibility  for 
creating  a  form  and  it  was  not  completed  until  early  1997. 
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Ironically,  though  confidentiality  laws  restrict  agencies'  ability  to  coordinate  care 
in  this  circumstance,  they  do  not  limit  the  ability  of  providers  to  share  information  with  a 
payer  to  seek  funding  for  services.  Utilization  Management  staff,  who  are  HHC 
employees,  play  a  coordinating  role  in  this  GAP,  as  they  approve  care  for  clients  being 
managed  by  GAP  caseworkers,  and  those  GAP  clients  whose  primary  clinicians  are  in 
different  divisions  of  the  GAP  parent  agencies.  This  coordinating  role  of  utilization 
management  is  limited—  they  approve  services  based  on  the  clinicians  current 
assessments,  not  based  on  their  on  knowledge  of  the  client's  long  term  history. 

New  Haven  is  probably  the  only  large  city  in  Connecticut  where  the  LMHA 
shares  so  much  responsibility  for  behavioral  health  services  for  indigent  clients  with 
another  agency.  The  added  complexity  of  this  GAP  site  demonstrates  three  points:  a)  the 
difficulty  of  centralized  (state  wide)  standardization  and  administration  when  an 
additional  agency  with  different  governance,  funding,  and  goals  is  introduced  into  the 
model;  b)  lack  of  one  true  authority  on  the  local  level  leads  to  service  fragmentation  and 
administrative  inefficiency;  and  c)  lack  of  control  over  referral  and  information  is 
minimized  by  centralized  utilization  management. 

4)  Intra-organizational  summary 

Cross  site  comparisons  show  opposite  intra-agency  effects  of  collocation  as  they 

did  for  interagency  relations  —  tensions  between  the  GAP  and  parent  agency  seem  to 
increase  as  collocation  increases.  This  make  intuitive  sense,  as  all  the  theorized  positive 
effects  that  come  from  sharing  space  and  spending  time  with  members  from  different 
agencies  should  be  proportionately  lost  with  the  parent  agency  as  GAP  clinicians  share 
less  space  and  time  with  their  parent  agency  colleagues.  This  effect  may  also  extend  to 
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the  clients,  who  would  be  seen  less,  and  have  less  incidental  contact,  with  other  parent 
agency  staff  the  more  they  are  treated  off  site.  New  Haven's  unique  hybrid  model,  in 
which  the  GAP  is  a  true  interagency  collaboration  and  in  which  staff  are  part  of  larger 
divisions  of  their  parent  agencies,  makes  it  difficult  to  generalize  about  collocation. 
However,  this  hypothesized  negative  effect  of  collocation  becomes  a  compelling 
explanation  of  differences  between  the  most  collocated  site  (Bridgeport)  and  the  least 
collocated  site  (Hartford)  in  terms  of  clinical  support  for  GAP  teams  through  back  up 
services  or  accepting  referrals  of  clients. 

Mental  health  and  substance  abuse  discipline  conflicts  are  the  second  major  intra- 
agency  theme.  LMHAs  do  not  easily  accommodate  the  clinical  needs  of  welfare  clients. 
Hartford  exemplified  the  training  aspects  of  this  conflict,  and  New  Haven  the  legal 
aspects.  These  agencies,  and  in  some  cases  the  GAPs  themselves,  have  had  to  loosen 
their  professional  roles  and  change  their  policies  to  serve  this  new  population.  The  ways 
in  which  the  GAPs  were  implemented  also  seem  to  have  had  some  influence  on  the  ease 
of  this  transition.  The  Hartford  GAP  claimed  it  benefited  from  leadership  with  cross 
training,  though  probably  it  would  have  done  better  if  cross  training  were  a  criteria  in 
staff  selection.  The  New  Haven  GAP's  difficulty  in  coordinating  full  clinical  information 
was  product  of  its  complicated  interagency  model,  and  the  resolution  of  this  problem  was 
further  hindered  (by  months,  if  not  years)  by  executive  leadership  through  committee.  In 
hindsight,  the  GAP  model  would  have  benefited  from  planning  that  paid  more  attention 
to  non-clinical  aspects  of  treating  an  unfamiliar  client  population. 
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3.  Publicly  operated  managed  care 

These  three  sites'  utilization  management  practices  differ  markedly  from  the 
traditional  private  sector  applications.  Structures  and  procedures  are  less  formal,  and  the 
utilization  management  process  is  intended  to  be  non-adversarial  with  providers. 

The  sites  differ  in  the  degree  of  structure  that  is  applied  to  utilization  management 
procedures.  In  the  New  Haven  site,  one  utilization  management  nurse  is  responsible  for 
all  network  care  approval.  The  Hartford  site  is  moderately  structured:  dedicated 
utilization  management  staff  approve  outpatient  care  mental  health;  but  inpatient  care  can 
only  be  approved  by  the  clinical  director.  The  Bridgeport  site  is  the  least  formal.  It 
limits  utilization  review  to  a  prior  authorization/gatekeeper  system,  where  any  care  must 
be  approved  by  any  GAP  clinician.  The  Bridgeport  gatekeeper  model  limits  access  to  an 
episode  of  care,  but  lacks  the  central  oversight  of  care  intensity  that  the  other  sites 
provide  through  their  utilization  management  staff,  thereby  allowing  providers  to  offer 
GA  clients  more  intensive  treatment,  such  as  extra  sessions  of  therapy,  etc.  without  close 
scrutiny.  Further,  Bridgeport  GAP  caseworkers  seem  to  see  themselves  more  as 
clinicians  and  patient  advocates  then  a  dedicated  utilization  management  staff,  whose 
primary  function  is  to  ensure  adequate  resources  for  the  entire  target  population. 
Bridgeport's  notions  of  patient  advocacy16  (Eisenberg,  1986;  Povar  &  Moreno,  1988; 
Daniels,  1985)  may  lessen  the  intensity  of  network  provider  oversight  regardless  of  the 
lack  of  structure  of  the  Bridgeport  system. 

The  second  striking  aspect  of  the  GAP  is  the  varying  informality  and  looseness  of 
its  networks.  Hartford  is  the  only  site  with  formal  agreements  with  its  network  providers. 

16  Though  Daniels  convincingly  describes  how  clinicians  can  ethically  ration  services  to  their  clients. 
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New  Haven  and  Bridgeport  have  special  arrangements  with  certain  providers  for  lower 
rates,  or,  specific  to  Bridgeport,  to  reserved  or  priority  treatment  slots.  Otherwise,  these 
sites  will  refer  their  clients  to  any  provider  that  will  treat  their  clients  well.  These 
accommodations  have  led  to  stable  provider  pools.  Although  all  sites  have  formal 
dispute  resolution  mechanisms,  they  are  rarely  used.  There  were  only  1  or  2  providers 
per  site  (in  two  years)  who  were  mentioned  as  causing  problems  for  the  LMHA. 

The  third  apparent  GAP  difference  from  private  managed  care  is  its  willingness  to 
work  with  and  educate  providers  about  managed  care  principles  and  treatment  standards. 
GAP  staff  seem  very  willing  to  work  with  providers  to  deal  with  difficult  cases,  learn 
procedures,  and  encourage  providers  to  learn  the  style  of  care  that  the  GAP  would  like 
their  clients  to  receive.  The  sites  share  utilization  management  protocols  with  providers 
so  they  can  learn  what's  encouraged  and  permissible.  Though  this  is  becoming  standard 
practice  in  public  sector  managed  care,  it  was  not  so  in  1 994  when  these  networks  were 
being  formed.  Further,  the  Hartford  site  held  formal  training  for  its  network  providers  on 
utilization  management  procedures,  and  the  other  sites  have  repeated  these  process 
informally  for  individual  providers.  In  the  two  sites  with  dedicated  utilization 
management  staff,  the  utilization  management  staff  seemed  to  trust  provider  assessments 
and  were  committed  to  ensuring  that  clients  received  every  service  that  they  needed.  One 
utilization  management  nurse  even  thinks  of  herself  as  doing  more  "case  management" 
than  utilization  management,  and  claims  that  providers  now  see  her  as  a  resource  and 
call  her  to  discuss  client  issues. 

Granted,  this  information  comes  primarily  from  GAP  and  GA  staff  interviews—no 
network  providers  were  interviewed.  However,  I  am  not  aware  of  any  formal  written 
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complaints  by  providers  to  DSS,  DMHAS,  or  the  LMHAs.  At  the  least,  this  lack  of 
contradictory  evidence  suggests  that  providers  felt  they  could  address  their  concerns  less 
formally. 

This  willingness  and  accommodation  seems  remarkable,  and  may  occur  for 
several  reasons.  First,  GAP  staff  seem  to  believe  that  honest  providers  cannot  make  large 
profits  serving  the  GA  population.  Most  interviewees  regarded  providers  who  willingly 
serve  GA  clients  as  doing  their  city  a  public  service,  and  want  to  keep  these  providers  in 
business.  GAP  staff  sympathy  for  these  providers  may  explain  the  reported  lack  of 
adversarial  interactions  between  GAP  utilization  management  staff  and  providers. 

Second,  though  these  three  GAPs  are  located  in  the  state's  largest  urban  areas, 
there  may  not  be  enough  behavioral  health  providers  for  GA  clients  to  compete  with  one 
another  on  price,  convenience,  or  quality  in  all  specialties.  In  fact,  virtually  all  GAP 
utilization  management  staff  interviewed  claimed  that  the  reimbursement  rates  from  GA 
for  services  were  so  low  that  "providers  were  not  going  to  make  a  lot  of  money  on  these 
services"  and  even  that  "we  are  lucky  that  we  can  find  providers  to  take  our  cases."  More 
concretely,  there  have  always  been  wait  lists  for  substance  abuse  inpatient  services 
throughout  the  state17.  Since  GAP  feel  providers  are  a  scarce  community  resource,  they 
may  be  less  willing  to  disenroll  providers  than  they  would  in  more  competitive  private 
sector  markets. 

Third,  GAP  staff  may  be  patient  with  providers  because  both  the  providers  and 
the  LMHAs  that  run  the  GAP  are  so  unfamiliar  with  private  sector  style  utilization 

17  GAP  staff  all  seem  to  think  that  some  treatment  resources  are  in  short  supply.  On  the  surface,  demand 
for  services  seems  to  exceed  supply,  but  where  wait  lists  exist,  most  clients  are  assigned  to  multiple  wait 
lists,  making  it  difficult  understand  the  true  of  supply  and  demand.  Further,  even  though  GA  clients  do  end 
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management.  The  utilization  management  nurses  in  Hartford  and  New  Haven  both 
spoke  of  the  need  to  train  providers  about  the  fundamentals  of  telephone  utilization 
management,  and  providers  in  all  sites  may  not  have  ever  had  to  communicate  and  justify 
their  treatment  plans  to  outsiders  before  (Connecticut  Medicaid  managed  care  came 
online  after  GAP  implementation).  Further,  the  GAP  is  a  learning  process  for  the 
LMHAs  and  DMHAS  in  general,  and  these  institutions,  being  new  to  managed  care,  may 
be  too  naive  to  set  firm  expectations. 

Finally,  providers  are  probably  the  most  powerful  interest  group  influencing 
public  sector  behavioral  health  care  in  Connecticut.  If  a  state-run  LMHA  instituted 
draconian  managed  care  methods,  there  probably  would  have  been  complaints  to 
legislators.  In  fact,  the  DMHAS  action  to  enter  the  GA  market  was  perceived  as  direct 
competition  to  some  traditional  providers.  The  effects  of  political  pressure  is  most 
obvious  in  the  New  Haven  site.  Here,  clinicians  from  several  different  agencies  in 
addition  to  the  LMHA  and  the  HHC,  including  the  local  Syringe  Exchange  Program  and 
a  drug  rehabilitation  center,  have  argued  for  and  received  the  same  referral  privileges  as 
the  GAP  triage  clinicians,  including  the  ability  to  refer  to  their  own  institutions  for 
treatment.  Though  these  referrals  still  must  be  approved  through  the  utilization 
management,  and  therefore  do  not  threaten  to  burden  the  GA  program  with  unnecessary 
treatment,  adding  these  additional  "Triage  Gates"  to  the  New  Haven  GAP  means  more 
staff  from  more  agencies  that  must  be  included  when  coordinating  training,  standards, 
information,  and  program  improvements.  Other  states,  such  as  Arizona  (Paringer  & 
McCall,  1991)  and  Iowa  (Hoge,  Jacobs,  Thakur  &  Griffith,  1998)  have  also  instituted 

up  on  wait  lists,  not  all  substance  abuse  programs  operate  at  full  capacity — perhaps  suggesting  that  access 
to  these  beds  may  depend  in  some  part  on  insurance. 
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special  protections  for  existing  provider  groups.  However,  these  other  studies  offer 
insight  on  more  macro  level  forces  (e.g.  providers  as  a  political  force  on  state  level 
policy)  and  did  not  explore  the  sympathies  of  line  staff. 

4.  Conclusion 

This  analysis  suggests  three  general  points  of  interest  to  those  trying  to  implement 
managed  care  across  traditional  service  sector  boundaries.  These  theories  are  supported 
by  observations  which  appear  robust  across  three  cases.  However,  given  the  limitations 
of  the  case  study  method,  it  would  be  premature  to  interpret  these  findings  beyond  the 
level  of  hypothesis. 

First,  collocation  appears  to  be  an  effective  way  to  establish  connections  between 
staff  from  different  service  agencies  or  even  different  professional  disciplines,  though  the 
implementation  of  these  programs  was  marked  with  confusion  and  tension.  With  this 
degree  of  enhanced  coordination  comes  the  price  of  reduced  interaction,  and  possibly  less 
productive  collaboration,  of  the  collocated  division  with  its  parent  agency.  This  tradeoff 
should  not  be  overstated  however.  It  is  unreasonable  to  assume,  and  not  observed,  that  a 
collocated  unit  should  identify  more  closely  to  its  host  agency  than  it  would  to  the  agency 
that  hired  its  staff  and  provides  its  funds. 

These  analyses  also  reveal  the  subtle  problems  associated  with  incorporating  a 
new  target  population  into  a  well  established  service  program.  As  Hartford  shows  us,  not 
only  do  line  staff  have  to  shift  their  thinking  to  accommodate  new  clients,  but  executives 
must  as  well,  as  they  and  their  agencies  are  forced  to  reorient  to  meet  the  needs  of  their 
new  clients.  New  Haven  is  an  especially  good  example  of  how  an  incomplete 
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conceptualization  of  the  target  population,  coupled  with  a  resistant  political  environment, 
has  led  to  an  overly  complicated  and  inefficient,  though  functional,  program  model. 

Finally,  regardless  of  the  original  intentions  of  many  public  sector  managed  care 
advocates,  it  seems  public  sector  managed  care  will  not  be  implemented  with  the  same 
cost  consciousness  or  rigor  as  it  is  has  been  in  the  private  sector.  Public  sector  staff  have 
clear  (though  untested)  assumptions  about  fragility  of  the  public  sector  market,  and  their 
concern  for  providers,  coupled  with  the  political  power  of  public  sector  providers,  can 
lead  to  a  considerably  more  accommodating  version  of  managed  care  than  would  be 
expected  when  designing  systems  to  deal  with  privately  insured  clients. 

These  issues  of  the  functional  effects  of  these  organizational  changes,  decreased 
costs,  increased  access  to  care,  and  managing  services  will  be  revisited  in  client  level 
analyses  presented  in  the  next  chapter. 
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Chapter  6:  Quantitative  Results 


This  chapter  presents  client  level  analyses  of  the  managed  care  decisions 
discussed  in  Chapter  2  (see  Figure  2-1).  The  first  decision  is  whether  the  General 
Assistance  Pilot  (GAP)  changes  access  to  DMHAS  care  for  people  with  GA  medical 
coverage.  These  access  analyses  are  presented  first,  followed  by  an  exploration  of  the 
efficiency  of  access  increases.  The  second  is  when  the  GAP  may  change  DMHAS 
utilization  patterns  for  people  with  GA  medical  coverage.  Following  the  presentation  of 
costs  models  is  a  discussion  differential  outcomes  in  all  the  models  by  diagnostic  group 
and  race. 

1.  Access  to  care 

The  GAPs  are  designed  to  increase  access  to  care  for  GA  clients.  As  discussed  in 
Chapter  4,  this  question  will  be  explored  through  Poisson  GEE  models  of  the  rate  at 
which  the  study  cohorts  first  access  DMHAS  care.  Collapsibility  tests  to  justify  the  use 
of  six  policy  periods  were  presented  in  Chapter  4. 

Of  the  24,849  subjects  from  Hartford,  8.7%  (n=2,154)  accessed  some  form  of 
DMHAS  care  during  the  follow-up.  Of  the  15,339  clients  from  New  Haven,  1 1.4% 
(n=  1,748)  accessed  some  form  of  DMHAS  care.  Due  to  right  and  left  censoring  ,  most 
clients  did  not  have  follow-up  time  during  all  policy  periods,  leaving  a  total  of  1 17,698 


18  Right  censoring  occurs  when  a  subject  is  assigned  a  negative  outcome  (in  this  case,  not  accessing 
DMHAS  care)  because  they  remain  an  active  member  of  the  cohort  up  to  or  past  the  very  end  of  the  follow- 
up  period.  Left  censoring  is  when  the  subject  joins  the  cohort  at  the  very  beginning  or  sometime  before  the 
follow-up  period.  In  these  analyses,  censoring  can  occur  at  the  start  and  end  of  each  policy  period. 
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period  level  observations  for  the  Hartford  Poisson  GEE  models,  and  68,91 1  period  level 
observations  for  the  New  Haven  Poisson  GEE  models. 

A.  One  way  models  and  frequencies 

Below  are  frequencies  and  univariate  models  for  each  city.  The  'Total'  column, 

unless  otherwise  noted,  is  the  unduplicated  number  of  clients  in  that  level.  Unduplicated 
values  remain  fixed  for  each  subject  over  the  six  periods.  For  the  Policy  Period  variable, 
the  total  column  indicates  the  number  of  unduplicated  subjects  and  their  outcomes  within 
each  Period  (a  duplicated  count  across  policy  periods).  GA  Start  and  Stop  code  counts, 
the  type  of  benefits  initially  assigned  (which  may  have  changed  by  the  end  of  GA 
medical  eligibility)  and  the  reason  for  ending  an  episode  of  GA  medical  benefits, 
respectively,  are  also  duplicated  since  they  are  different  for  each  GA  episode.  If  a  subject 
had  multiple  episodes  of  GA  benefits  during  one  policy  period,  the  codes  immediately 
preceding  the  outcome  (either  no  access  at  the  end  of  the  period  or  access  to  any  DMHAS 
care)  were  used.  Subjects  that  were  right  censored  while  their  GA  medical  benefits  were 
active  had  their  GA  Stop  code  variable  defined  as  censored.  Similarly,  subjects  who 
started  the  follow-up  with  active  GA  benefits  had  no  known  reason  for  their  GA  episode, 
and  therefore  had  their  GA  Start  code  defined  as  censored. 

The  'No.  with  outcome'  column  shows  the  unduplicated  number  of  people  who 
ultimately  receive  some  form  of  DMHAS  service.  Relative  risks  and  their  significance 
levels  come  from  the  GEE  estimates  of  one-way  models  that  include  observations  from 
all  policy  periods. 
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Table  6-1:  Hartford  unadjusted  access  models 

Variable 

Total 

No  with  outcome 

Outcome  % 

RR 

Pval 

Number  of  GA  episodes 

1 

17831 

1510 

8.47% 

1.10 

0.1374 

2 

4438 

376 

8.47% 

0.90 

0.1722 

3+ 

2580 

268 

10.39% 

1.00 

— 

GA  Status  at  outcome  (duplicated) 

Inactive 

78406 

447 

0.57% 

0.11 

0.0000 

Transitional 

281 

0 

0% 

Active 

39011 

1707 

4.38% 

1.00 

— 

GA  coverage  during  Period  1 

No 

12585 

1268 

10.08% 

2.68 

0.0000 

Yes 

12264 

886 

7.22% 

1.00 

— 

GA  coverage  during  Period  2 

No 

14346 

1213 

8.46% 

1.05 

0.2839 

Yes 

10503 

941 

8.96% 

1.00 

GA  coverage  during  Period  3 

No 

8860 

619 

6.99% 

0.96 

0.4980 

Yes 

15989 

1535 

9.60% 

1.00 

GA  coverage  during  Period  4 

No 

16557 

1460 

8.82% 

2.03 

0.0000 

Yes 

8292 

694 

8.37% 

1.00 



GA  coverage  during  Period  5 

No 

17927 

1413 

7.88% 

0.14 

0.0000 

Yes 

6922 

741 

10.70% 

1.00 

— 

GA  coverage  during  Period  6 

No 

17895 

1865 

10.42% 

6.73 

0.0000 

Yes 

6954 

289 

4.16% 

1.00 



Period 

1 

12264 

39 

0.32% 

0.14 

0.0000 

2 

15302 

51 

0.33% 

0.27 

0.0000 

3 

21896 

751 

3.43% 

0.88 

0.0384 

4 

22356 

279 

1 .25% 

0.95 

0.5496 

5 

22763 

612 

2.69% 

2.55 

0.0000 

6 

23117 

422 

1.83% 

1.00 

— 

GA  Stop  code 

Censored/Missing/Other 

43765 

1602 

3.66% 

5.26 

0.0000 

Employed 

8904 

61 

0.69% 

0.86 

0.2861 

Other  aid 

11400 

62 

0.54% 

0.71 

0.0124 

Non  rnmnlianrf3 

53629 

429 

0.80% 

1.00 

Race/Ethnicity 

Missing 

152 

12 

7.89% 

Black,  Non  Hispanic 

9583 

730 

7.62% 

0.46 

0.0000 

Hispanic 

12748 

1114 

8.74% 

0.57 

0.0000 

Other 

564 

35 

6.21% 

0.40 

0.0000 

White,  Non-Hispanic 

1802 

263 

14.59% 

1.00 

Sex 

Missing 

20 

1 

5.00% 

Female 

8890 

843 

9.48% 

1.22 

0.0000 

Male 

15939 

1310 

8.22% 

1.00 

Age-  Continuous 

N 

Mean 

StdDev 

RR 

Pval 

No  Access 

22695 

34.01 

11.31 

1.02 

0.0000 

Access 

2154 

36.78 

10.43 

Table  6-2:  New  Haven  unadjusted  access  models 


Variable 

Total 

No  with  outcome 

Outcome  % 

RR 

Pval 

Number  of  GA  episodes 

1 

9601 

912 

9.50% 

0.76 

0.0000 

2 

3426 

434 

12.67% 

0.84 

0.0117 

3+ 

2312 

402 

17.39% 

1.00 

_ 

GA  Status  at  outcome  (Duplicated) 

Inactive 

47437 

378 

0.80% 

0.11 

0.0000 

Transitional 

104 

0 

0% 

Active 

21370 

1370 

6.41% 

1.00 

— 

GA  coverage  during  Period  1 

No 

8264 

873 

10.56% 

1.65 

0.0000 

Yes 

7075 

875 

12.37% 

1.00 

— 

GA  coverage  during  Period  2 

No 

8432 

877 

10.40% 

1.14 

0.0068 

Yes 

6907 

871 

12.61% 

1.00 

- 

GA  coverage  during  Period  3 

No 

7050 

727 

10.31% 

1.01 

0.9315 

Yes 

8289 

1021 

12.32% 

1.00 

- 

GA  coverage  during  Period  4 

No 

10012 

1157 

11.56% 

1.23 

0.0082 

Yes 

5327 

591 

11.09% 

1.00 

— 

GA  coverage  during  Period  5 

No 

9977 

1167 

11.70% 

0.58 

0.0000 

Yes 

5362 

581 

10.84% 

1.00 

_ 

GA  coverage  during  Period  6 

No 

11944 

1557 

13.04% 

2.39 

0.0000 

Yes 

3395 

191 

5.63% 

1.00 



Period  (duplicated  count) 

1 

7075 

99 

1.40% 

0.46 

0.0001 

2 

9148 

115 

1.26% 

0.50 

0.0001 

3 

12233 

458 

3.74% 

0.91 

0.0125 

4 

12753 

273 

2.14% 

1.14 

0.0027 

5 

13840 

532 

3.84% 

1.14 

0.0006 

6 

13862 

271 

1 .95% 

1.00 

- 

GA  Stop  code  (duplicated  count) 

Censored/Missing/Other 

28343 

1275 

4.50% 

4.27 

0.0000 

Employed 

2605 

24 

0.92% 

0.74 

0.1457 

Other  aid 

16438 

162 

0.99% 

0.81 

0.0283 

Non  compliance 

23273 

287 

1 .23% 

1.00 

_ 

GA  Start  code  (duplicated  count) 

Inactive 

32873 

276 

0.84% 

0.55 

0.0004 

Home  and  medical 

14659 

463 

3.16% 

2.37 

0.0000 

Rent  and  medical 

18519 

854 

4.61% 

3.10 

0.0000 

Food  and  medical 

2276 

103 

4.53% 

2.90 

0.0000 

Medical  only 

164 

11 

6.71% 

4.70 

0.0000 

Other/  censored 

2168 

41 

1.89% 

1.00 

Imputed  Age — Continuous 

N 

Mean 

StdDev 

RR 

Pval 

No  Access 

13591 

32.67 

11.08 

1.005 

0.0005 

Access 

1748 

33.86 

8.37 

Raw  Age — Continuous 

No  Access 

10706 

32.91 

12.52 

1.003 

0.0532 

Access 

1318 

33.65 

9.62 
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The  repeated  aspect  of  many  of  these  variables  can  lead  to  some  seemingly 
strange  results.  For  example,  the  Hartford  GA  enrollees  with  one  GA  episode  have  the 
same  outcome  percentage  as  the  Hartford  GA  enrollees  with  two  GA  episodes,  yet  their 
relative  risks  for  accessing  care  are  different.  The  relative  risks  differ  because  subjects 
with  2  GA  episodes  are  in  the  cohort  longer  before  accessing  care. 

Because  of  the  large  sample  sizes,  any  statistical  testing  should  be  done  at  a= 
0.01.  By  this  criteria,  two  variables,  the  Number  of  GA  Episodes  and  GA  Stop  codes 
(reasons  for  losing  GA  medical  coverage)  have  little  variation  in  either  site,  or  vary  most 
greatly  between  the  censored  level  and  all  others.  Even  though  these  variables  do  not 
appear  to  predict  access  to  care,  they  will  be  included  in  the  model  building  process  as 
potential  confounders.  Some  of  the  GA  coverage  variables  are  also  not  significant, 
suggesting  that  being  on  GA  in  that  period  had  little  effect  on  a  client  accessing  care. 
However,  these  coverage  variables  are  designed  to  work  together  as  a  statistical 
correction  to  the  unstructured  Period  correlations  in  the  GEE  model,  and  are  best 
interpreted  as  a  group.  This  vector  of  variables  will  be  discussed  in  greater  detail  later. 

As  discussed  in  the  Methods  chapter,  there  was  a  fairly  high  rate  of  missing  dates 
of  birth  in  the  New  Haven  data  set.  I  attempted  to  impute  missing  values  by  replacing 
them  with  the  mean  age  for  one  of  five  categories  based  on  a  subject's  final  outcome:  1) 
no  access  to  care  by  the  end  of  the  study  period;  2)  access  to  care  while  on  GA  with 
follow-up  care;  3)  access  to  care  while  on  GA  and  no  follow-up  care;  4)  access  to  care 
while  off  GA  and  follow-up  care;  5)  and  access  to  care  while  of  GA  and  no  follow-up 
care.  Though  the  relative  risks  for  the  imputed  and  non-imputed  variables  are  similar, 
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the  imputed  age  RR  is  slightly  similar  and  more  significant.  The  imputation  process 
introduced  a  positive  bias,  so  Age  will  be  dropped  from  New  Haven  models. 

Also  as  discussed  in  the  Methods  chapter,  the  likelihood  of  receiving  any 
DMHAS  care  while  on  GA  is  expected  to  vary  over  time.  I  speculated  that  the  GAPs  or 
the  LMHAs  may  help  clients  obtain  GA  benefits  after  their  first  contact  with  DMHAS 
(because  of  the  sampling  frame,  this  would  be  after  their  first  known  GA  episode  had 
ended).  The  Transitional  level  of  the  GA  Status  variable  indicates  whether  the  outcome 
occurred  within  5  days  before  the  start  of  a  new  GA  episode.  Since  this  never  occurred  in 
the  sample,  it  is  unlikely  that  the  GAPs  were  able  to  help  people  get  GA  benefits  (at  least 
that  quickly),  and  the  transitional  category  was  collapsed  into  the  inactive  category  for 
future  analyses. 

To  correspond  with  the  crude  access  rates  presented  in  Figures  4-1  and  4-2, 
separate  models  for  each  site  fitting  an  interaction  between  Period  and  GA  Status  at 
outcome  (enrolled  or  not  enrolled  at  the  end  of  a  period  or  when  receiving  care)  were 
run.  They  clearly  show  a  change  in  access  over  time.  Parameter  estimates  have  been 
converted  into  daily  rates  per  period  by  exponentiating  the  linear  predictor,  and  these 
values  have  been  converted  into  monthly  rates  per  thousand  people.  Confidence  intervals 
are  also  displayed. 
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Figure  6-1:  Hartford  unadjusted  access  rates 


Hartford  unadjusted  Period  GA  status  interaction,  with  99%  CI  bars 


Figure  6-2:  New  Haven  unadjusted  access  rates 


New  Haven  unadjusted  Period  GA  status  Interaction,  with  99%  CI  bars 


.  Not  in  GA  at  Incident  Treatment 
-  In  GA  at  Incident  Treatment 


Both  graphs  are  nearly  identical  to  their  counterparts  in  Chapter  4.  The  Hartford 
model  captures  the  spike  in  Period  5,  and  the  New  Haven  model  captures  the  plateau 
effect  in  Periods  5  and  6.  Most  notably,  during  implementation  of  the  GAP  at  the  start  of 
Period  3,  access  to  care  begins  to  rapidly  diverge  by  GA  status.  Because  this  interaction 
is  statistically  and  theoretically  significant,  it  is  appropriate  to  consider  it  as  an  effect 
modification  in  future  models. 

The  Poisson  GEE  derived  rates  show  a  greater  difference  in  access  by  GA  status 
than  the  crude  rates  in  Figures  4-1  and  4-2.  This  may  be  caused  by  differences  between 
counting  methods  for  the  crude  incident  rates  and  the  Poisson  model.  The  crude 
incidence  rates  simply  counted  the  events  in  a  month  for  each  category,  and  divided  by 
the  total  number  of  eligible  people  in  that  month.  In  the  Poisson  model,  clients  can  only 
have  a  non-event  at  the  end  of  a  period,  but  can  have  their  first  access  to  care  at  any  time. 
Since  getting  care  faster  is  an  important  dimension  of  access,  the  Poisson  model  is  a  more 
accurate  representation  of  the  data. 

B.  Access  model  selection 

With  strong  evidence  that  the  GAPs  increase  access  to  care,  I  proceeded  with 

multivariate  modeling.  Since  the  GEE  models  on  SAS's  Proc  GENMOD  do  not  yield 
accurate  goodness  of  fit  statistics,  I  relied  solely  on  Wald  tests  (testing  H0:  (3=0).  Initial 
models,  which  include  all  available  main  effects  and  Period  GA  Status  interaction,  are 
shown  below. 
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Table  6-3:  Hartford  access  base  model 


Parameter 

Estimate 

StdErr  Pr>|Z| 

INTERCEPT 

-10.9248 

0.1799 

o 

Period 

1 

-10.0656 

0.3324 

o 

2 

-9.2506 

0.3140 

o 

3 

-5.8157 

0.2594 

o 

4 

-3.9914 

0.2515 

o 

5 

-1.1374 

0.218 

n 

6 

0 

o 

o 

GA  Status  at  outcome 

Inactive 

-8.7328 

UxOOO 

u 

Active 

0 

n 

u 

Period  Status  interaction 

1,  Inactive 

8.4056 

n 
u 

1 ,  Active 

0 

o 

n 

2,  Inactive 

7.7977 

O 

n 

2,  Active 

0 

n 
u 

n 

3,  Inactive 

4.3923 

n  "^177 

n 

3,  Active 

0 

n 

n 
u 

4,  Inactive 

3.6578 

n  7nft<^ 
u.ouoo 

U 

4,  Active 

0 

n 
u 

u 

5,  Inactive 

1.2817 

n  9777 

U 

5,  Active 

0 

u 

n 
u 

6,  Inactive 

0 

n 
u 

n 
U 

6,  Active 

0 

u 

n 
u 

Race/Ethnicity 

Black,  Non  Hispanic 

-0.3825 

0.0802 

0 

Hispanic 

-0.308 

0.0764 

0.0001 

Other 

-0.6265 

0.1568 

0.0001 

White,  Non-Hispanic 

0 

0 

0 

Sex 

Female 

0.0841 

0.0461 

0.0677 

Male 

0 

0 

0 

Number  of  GA  episodes 

1 

0.1589 

0.0824 

0.0539 

2 

-0.1646 

0.0868 

0.0581 

3+ 

0 

0 

0 

Table  6-3:  Hartford  access  base  model,  continued 


Parameter  Estimate  StdErr  Pr>|Z| 


GA  coverage  during  Period  1 

No 

0.3138 

0.0539 

0 

Yes 

0 

0 

0 

GA  coverage  during  Period  2 

No 

0.0068 

0.054 

A  AAAj4 

0.9004 

Yes 

0 

0 

0 

GA  coverage  during  Period  3 

No 

a  nco 

0.053 

0.0704 

A  A  COO 

0.4522 

Yes 

L) 

r\ 
U 

U 

GA  coverage  during  Period  4 

No 

1.7353 

0.0594 

0 

Yes 

U 

U 

U 

GA  coverage  during  Period  5 

No 

1.4875 

0.094 

0 

Ypc 

n 

n 

n 

GA  coverage  during  Period  6 

No 

6.1894 

0.2287 

0 

Yes 

0 

0 

0 

GA  Stop  Code 

Censored/Missing/Other 

1.2273 

0.0574 

0 

Employed 

-0.313 

0.1264 

0.0133 

Other  aid 

-0.6429 

0.1397 

0 

Non  compliance 

0 

0 

0 

Age 

Continuous 

0.0078 

0.0018 

0 

Scale 

0.3197  . 

Table  6-4:  New  Haven  access  base  model 


Parameter  Estimate  StdErr  Pr>|Z| 


INTERCEPT 

-11.6702 

0.2815 

0 

Period 

1 

-9.6567 

0.485 

0 

2 

-9.0149 

0.4912 

0 

3 

-6.7814 

0.4786 

0 

4 

-4.4933 

0.4836 

0 

5 

-2.3141 

0.4706 

0 

6 

0 

0 

0 

GA  Status  at  outcome 

Inactive 

-8.7869 

0.6119 

0 

Active 

0 

0 

0 

Period  Status  interaction 

1,  Inactive 

6.3968 

0.715 

0 

1 ,  Active 

0 

0 

0 

2,  Inactive 

6.841 

0.6634 

0 

2,  Active 

0 

0 

0 

3,  Inactive 

5.3575 

0.5893 

0 

3,  Active 

0 

0 

0 

4,  Inactive 

4.0918 

0.5396 

0 

4,  Active 

0 

0 

0 

5,  Inactive 

1.9224 

0.5148 

0.0002 

5,  Active 

0 

0 

0 

6,  Inactive 

0 

0 

0 

6,  Active 

0 

0 

0 

GA  coverage  during  Period  1 

No 

0.0853 

0.066 

0.1965 

Yes 

0 

0 

0 

GA  coverage  during  Period  2 

No 

0.2889 

0.0682 

0 

Yes 

0 

0 

0 

GA  coverage  during  Period  3 

No 

0.4809 

0.0786 

0 

Yes 

0 

0 

0 

GA  coverage  during  Period  4 

No 

1.4428 

0.0758 

0 

Yes 

0 

0 

0 

GA  coverage  during  Period  5 

No 

2.7357 

0.1276 

0 

Yes 

0 

0 

0 

GA  coverage  during  Period  6 

No 

7.0204 

0.4556 

0 

Yes 

0 

0 

0 

Table  6-4:  New  Haven  access  base  model,  continued 


Parameter 

Estimate 

StdErr 

Pr>|Z| 

GA  Start  code 

Inactive 

-0.8294 

0.277 

0.0027 

Home  and  medical 

0.5279 

0.1537 

0.0006 

Rent  and  medical 

0.7246 

0.1526 

0 

Food  and  medical 

1.2564 

0.1739 

0 

Medical  only 

1.7322 

0.3386 

0 

Other/  censored 

0 

0 

0 

GA  Stop  code 

Censored/Missing/Other 

0.6113 

0.0765 

0 

Employed 

0.0023 

0.2057 

0.9910 

Other  aid 

0 

0.1016 

0.9998 

Non  compliance 

0 

0 

0 

Number  of  GA  episodes 

1 

0.0804 

0.0875 

0.3584 

2 

-0.0316 

0.072 

0.6603 

3+ 

0 

0 

0 

Scale 

0.3789 

In  the  above  two  tables,  the  significance  level  of  each  Wald  test  is  listed  under  the 
'P  >|Z|'  column.  These  Wald  tests  are  not  completely  accurate  for  the  interaction  terms, 
but  they  are  all  so  low  (less  than  0.0000)  that  I  am  confident  that  their  results  are 
significant. 

It  is  usually  considered  more  conservative  to  end  model  building  and  selection  at 
this  point,  and  not  remove  any  variables  from  the  multivariate  model.  Though  this 
method  is  guaranteed  to  describe  a  higher  portion  of  the  variance  than  one  that  only 
includes  significant  variables,  a  model  that  only  includes  significant  effects  and  their 
confounders  is  easier  to  interpret.  Since  these  data  have  been  combined  from  several 
different  administrative  data  sets,  any  interpretation  is  difficult.  Eliminating  unnecessary 
variables  helps  focus  on  the  key  relationship-  the  Period  GA  status  interaction. 

Several  variables  do  not  appear  significant  at  the  ct=01  level,  and  these  should 
receive  further  consideration  before  they  are  included  in  the  final  model.  They  are:  Sex 
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in  the  Hartford  data  set;  and  in  both  the  Hartford  and  New  Haven  data  sets,  Number  of 
GA  episodes  and  GA  stop  codes  ( the  reason  for  GA  benefit  termination).  These  three 
variables  were  evaluated  for  confounding  and  results  are  shown  below.  Specific 
estimates  which  appear  to  be  confounded  are  boldfaced. 
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Table  6-5:  Hartford  access  confounding  check 


Parameter  Base  model  Base+Stop  code  Base+Sex  Base*  GA  Episode  Count 


INTERCEPT 

-9.9773 

-11.0031 

-9.9879 

-10.0782 

Period 

1 

-9.0303 

-10.0069 

-9.0397 

-9.3787 

2 

-8.2095 

-9.1821 

-8.2214 

-8.5707 

3 

-5.0662 

-5.758 

-5.0792 

-5.3252 

4 

-3.8012 

-3.9464 

-3.8124 

-3.9805 

5 

-1.0908 

-1.1266 

-1.0877 

-1.1256 

6 

0 

0 

0 

0 

GA  Status  at  outcome 

Inactive 

-8.6596 

-8.6244 

-8.6737 

-9.0154 

Active 

0 

0 

0 

0 

Period  Status  interaction 

1,  Inactive 

7.5294 

8.3389 

7.536 

7.8852 

1 ,  Active 

0 

0 

0 

0 

2,  Inactive 

6.8364 

7.7204 

6.8466 

7.2019 

2,  Active 

0 

0 

0 

0 

3,  Inactive 

3.6615 

4.3326 

3.6747 

3.9183 

3,  Active 

0 

0 

0 

0 

4,  Inactive 

3.4728 

3.6128 

3.4843 

3.6504 

4,  Active 

0 

0 

0 

0 

5,  Inactive 

1.2355 

1.2709 

1.2326 

1.2703 

5,  Active 

0 

0 

0 

0 

6,  Inactive 

0 

0 

0 

0 

6,  Active 

0 

0 

0 

0 

Race/Ethnicity 

Black,  Non  Hispanic 

-0.4443 

-0.3917 

-0.4479 

-0.4013 

Hispanic 

-0.3314 

-0.305 

-0.3388 

-0.3291 

Other 

-0.5382 

-0.597 

-0.5562 

-0.6014 

White,  Non-Hispanic 

0 

0 

0 

0 

GA  coverage  during  Period  1 

No 

0.4559 

0.3843 

0.4463 

0.2596 

Yes 

0 

0 

0 

0 

GA  coverage  during  Period  2 

No 

0.0053 

0.02 

0.0014 

-0.0301 

Yes 

0 

0 

0 

0 

GA  coverage  during  Period  3 

No 

0.2084 

0.119 

0.1913 

0.043 

Yes 

0 

0 

0 

0 

GA  coverage  during  Period  4 

No 

1.5818 

1.748 

1.5821 

1 .5743 

Yes 

0 

0 

0 

0 

GA  coverage  during  Period  5 

No 

1.0331 

1.4944 

1.0344 

1 .0603 

Yes 

0 

0 

0 

0 

GA  coverage  during  Period  6 

No 

5.8146 

6.1417 

5.8216 

6.0236 

Yes 

0 

0 

0 

0 

Age 

Continuous 

0.013 

0.009 

0.0119 

0.0102 
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Table  6-5:  Hartford  access  confounding  check 


 Parameter  Base  model  Base+Stop  code  Base+Sex  Base+  GA  Episode  Count 

GA  Stop  code 

Censored/Missing/Other  1 .3025 

Employed  -0.3039 
Other  aid  -0.6133 
Non  compliance  0 
Sex 

Female  0.1827 
Male  0 
Number  of  GA  episodes 

1  0.6041 

2  -0.1053 
 3+  0 
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Table  6-6:  New  Haven  access  confounding  check 


D  -a  fri  m  afar 

Jdbc 

□d5cT  OM  OLOp  DdSc 

~  vjM  cpisoue  couni 

liM  1  cKUcr  1 

-1 1  .OZ4 

1-1    1  HO 

-i  1 .14Z 

rerlOu 

4 

1 

-y.4DD/ 

-y.o4/o 

-y.oziu 

o 

q  any  a 

-y.uu^4 

-o.oooo 

o 
0 

-O.OO  1 1 

A  7707 

-O.  /UU/ 

4 

A  AOfW. 

-4.4<:U1 

-4.40/ O 

-4.44  /  Z. 

B 
0 

-^.G0y4 

-^.OOOU 

b 

u 

U 

U 

OA  status  at  outcome 

Inactive 

-y.  iuy4 

-O./DI  1 

-y.  To  ib 

Active 

u 

U 

0 

Period  Status  interaction 

1,  Inactive 

c  ion 

b.oo2o 

o  inn 

6.2922 

1 ,  Active 

U 

L) 

0 

<l.  inacuve 

o.ooyy 

O.oZDD 

O./O  10 

2,  Active 

0 

0 

0 

3,  Inactive 

C  OCT1 

5.2623 

c  o  >i  no 

5.3492 

5.2965 

o,  Mciive 

u 

U 

u 

4,  Inactive 

4.016 

a  nOCn 

4.0859 

4.0431 

4,  Active 

r\ 
U 

0 

0 

0,  iridCllvc 

i  .y  /  oo 

i  .yozy 

5,  Active 

u 

U 

U 

6,  Inactive 

U 

U 

0 

n 

u 

U 

GA  coverage  during  Period  1 

NO 

U.140O 

U.  1  uuz 

u.uyo  1 

Vac 

I  CO 
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Table  6-6:  New  Haven  access  confounding  check,  continued 


Parameter 


Base 


Base*  GA  Stop  Base  +  GA  Episode  count 


GA  Stop  code 

Censored/Missing/Other 

Employed 

Other  aid 

Non  compliance 

Number  of  GA  episodes 


0.6316 
0.0029 
0.0001 
0 


2 

3+ 


0.2324 
-0.0204 
0 


In  the  Hartford  data  set,  GA  Stop  codes,  or  reason  for  ending  GA  medical 
benefits,  is  a  very  mild  confounder  of  the  Intercept,  Period,  and  Period  GA  status 
interaction,  so  it  was  retained  for  the  final  Hartford  model.  In  the  New  Haven  model, 
both  the  GA  Stop  codes  and  the  maximum  Number  of  GA  episodes  mildly  confound  the 
enrolled  on  GA  medical  coverage  in  Period  1  variable.  However,  since  this  is  not  a 
variable  of  primary  interest,  I  did  not  retain  any  confounders  for  New  Haven.  Final 
models  for  each  city  are  presented  below. 
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C.  Final  Access  models 


Table  6-7:  Final  access  models  for  both  sites 
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Table  6-7:  Final  access  models  for  both  sites,  continued 


Hartford 

New  Haven 

Parameter 

Estimate 

StdErr 

Pr>IZI 

Pcti  ma  to 

L.O  LI  1  Halt; 
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Hispanic 

-0.305 

0.077 

0.0001 

Other 

-0.597 

0.157 

0.0001 

White,  Non-Hispanic 

0 

0 

0 

GA  Start  code 

Inactive 

-0.9344 

0.274 

0.0006 

Home  and  medical 

0.4353 

0.153 

0.0044 

Rent  and  medical 

0.5011 

0.145 

0.0006 

Food  and  medical 

1.1431 

0.162 

0 

Medical  only 

1.6125 

0.324 

0 

Other/  censored 

0 

0 

0 

Scale 

0.3202 

0.3806 

The  covariates  in  the  final  models  reveal  some  interesting  effects.  Age  at  start  of 
follow-up  has  a  modest,  though  significant,  effect  on  access  to  care  in  Hartford — a  30 
year  old  is  1 .09  times  more  likely  to  access  DMHAS  services  than  a  20  year  old.  The 
Race/Ethnicity  variable  in  the  Hartford  dataset  also  appears  interesting,  but  racial 
differences  will  be  discussed  in  later  models. 

The  Hartford  GA  stop  codes  also  warrant  further  explanation.  A  person  who 
loses  GA  benefits  in  Hartford  due  to  non-compliance  is  1.8  times  more  likely  to  access 
care  than  some  one  who  receives  other  aid.  This  probably  reflects  the  underlying  need 
for  services  among  each  group  of  people.  The  subjects  who  receive  other  aid  may  have  a 
more  severe  condition  that  requires  services  from  a  non-behavioral  health  provider,  or 
had  their  other  benefits  start  before  their  GA  aid  was  terminated19.  The  censored/missing 
category  has  a  high  parameter  estimate,  and  this  is  probably  an  artifact  due  to  the 
censoring  process. 


The  potential  billing  errors  are  reconciled  on  the  state  level,  but  the  corrections  would  not  affect  DMHAS 
or  be  reflected  in  the  available  data. 
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Start  codes  from  New  Haven,  which  describe  the  initial  types  of  benefits  that  the 
subject  received,  yield  strong  results  that  are  also  hard  to  interpret.  All  of  the  subjects  in 
the  cohorts  have  their  GA  medical  benefits.  The  other/censored  category,  chosen  here  as 
the  baseline,  is  comprised  of  other  additional  benefits,  such  as  utilities,  or  clothing,  and 
those  clients  who  had  an  ongoing  GA  episode  at  the  start  of  follow-up  (left-censored). 
People  with  medical  only  benefits  have  the  highest  chance  to  access  DMHAS  care,  with  a 
RR  of  4.9.  People  also  with  food  assistance  are  3  times  more  likely  to  access  care.  This 
information  is  most  useful  when  trying  to  anticipate  further  service  demand,  as  it  may 
indicate  some  group  differences  in  underlying  clinical  need. 

The  intercept  and  the  parameter  estimates  for  Period,  GA  Status,  and  the 
interaction  terms  yield  even  more  interesting  results.  They  are  either  very  large  or  very 
small,  which  speaks  to  the  dramatic  increase  in  access  rates  over  the  follow-up  period. 
Increased  access  was  almost  entirely  concentrated  among  Active  GA  clients.  The 
following  two  figures  display  the  effect  modification  by  graphing  the  linear  predictors. 
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Figure  6-3:  Hartford  access  final  model,  Period*  GA  status  at  access 


Hartford  Final  Adjusted  Access  Model,  with  99%  CI 
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Figure  6-4:  New  Haven  access  final  model,  Period*  GA  Status  at  access 


New  Haven  Final  Adjusted  Access  Model,  with  99%  CI 
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Both  graphs  show  a  similar  non-significant  rise  in  access  among  non  GA  clients, 
and  a  very  large  increase  in  access  among  active  GA  recipients.  When  compared  to 
Figure  6-1  and  Figure  6-2,  final  models  also  show  a  smoother  GA  access  trend. 
Hartford's  Period  5  spike  is  gone,  and  New  Haven's  Period  5  to  6  plateau  has  been 
replaced  by  a  constant  positive  slope.  This  smoothing  effect  is  explained  by  the  inclusion 
of  GA  enrollment  status  of  subjects  during  each  period  to  the  model. 

The  graphs  are  seemingly  contradicted  by  opposite  trend  found  in  the  Enrollment 
by  period  parameter  estimates  on  Table  6-7.  This  vector  of  six  variables  display  a 
dramatic  trend  of  people  not  enrolled  in  GA  within  a  period  becoming  more  likely  to  get 
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care  than  people  on  GA,  culminating  in  Period  6  of  each  model  with  parameter  estimates 
of  6.1  and  6.9. 

However,  the  GA  enrollment  by  period  variables  are  in  the  model  only  as 
statistical  controls,  and  should  not  be  directly  interpreted.  If  the  Period  6  enrollment 
variable  is  dropped  from  the  model,  the  Period  GA  status  interaction  reverts  back  to  its 
Figure  6-1  and  Figure  6-2  shapes.  If  any  of  the  other  5  enrollment  period  variables  are 
dropped,  the  adjusted  models  do  not  converge. 

The  difference  between  the  crude  and  the  adjusted  trend  is  due  to  each  subject's 
pattern  of  GA  eligibility,  and  also  to  larger  changes  in  the  cohort.  Subjects  are  removed 
from  the  cohort  after  their  first  contact  with  DMHAS  care,  and  the  GAP  is  most  likely  to 
remove  people  while  they  have  GA  coverage.  By  Period  6,  there  are  few  subjects  left 
who  still  have  GA  medical  benefits,  though  GAPs  continue  to  focus  on  screening  this 
shrinking  subject  pool.  This  trend  was  exacerbated  by  the  decline  in  new  subjects 
entering  the  cohort  (after  Period  3,  only  12%  of  the  Hartford  cohort  entered  the  study, 
and  19%  of  the  New  Haven  cohort  entered  the  study)  which  was  due,  in  part,  to  more 
restrictive  GA  enrollment  polices,  lower  unemployment  rates,  and  lower  cash  benefits. 
The  GAP  removes  GA  enrolled  subjects  from  the  cohort  faster  than  GA  enrolled  subjects 
can  enter,  hence  the  proportion  of  subjects  with  active  GA  benefits  shrinks,  while  the 
number  of  clients  accessing  care  with  active  GA  benefits  remains  fairly  stable. 

If  these  trends  continue,  eventually  the  access  rate  would  reach  some  equilibrium 
with  the  rate  of  new  entries  into  the  GA  pool.  This  equilibrium  was  not  reached  during 
the  follow-up  period,  and  since  the  overall  rates  are  still  quite  low  (the  intercepts  are 
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very  small),  they  may  not  for  some  time.  When  they  do  stabilize,  DMHAS  should 
probably  adjust  the  effort  the  GAPs  devote  to  case  finding. 

D.  Cross-Site  comparisons 

To  further  quantify  the  Period  GA  Status  effect  modification,  the  final  model  for 

each  city  was  re-run  with  the  Periods  as  a  continuous  variable.  The  sample  was  restricted 
to  Periods  2-6,  where  the  GA  and  non-GA  slopes  begin  to  diverge.  The  interaction  term 
yields  the  rate  of  change  between  GA  and  non-GA  access  rates.  In  Hartford,  GA  access 
climbed  7.3  times  faster  per  period  than  non  GA  access  rates  (99%  CI:  6.2,8.6).  In  New 
Haven,  GA  access  increased  5.9  times  faster  (99%  CI:  4.6,7.2). 

To  compare  the  relative  changes  in  GA  access  rates  between  cities,  a  model  was 
fit  with  Period  as  a  continuous  variable,  interacted  with  GAP  cites,  and  adjusted  by  the 
common  cofounders  of  GA  Stop  code  and  GA  enrollment  by  period.  The  sample  was 
restricted  to  events  that  only  occurred  when  GA  benefits  were  active  (non  events  at  the 
end  of  each  period,  and  access  to  care),  and  to  when  the  GA  access  sloped  reached  their 
true  shapes  (Periods  2-6).  The  results  of  this  model  are  presented  below. 
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Table  6-8:  Hartford  and  New  Haven  access  rate  joint  model,  Periods  2-6 

 Parameter  Estimate  StdErr  99%  CI 

INTERCEPT                        -28.5641  0.3805    (-29.449,  -27.679) 
Policy  Periods  from  2-6 

Continuous                            2.7644  0.0467      (2.656  2  873) 
GAP  Site 

New  Haven                           1.O8O6  0.1367  (0.763,1.399) 

Hartford                                     0  0  — 
Policy  Period  Site  Interaction 

Time*New  Haven                    -0.2860  0.0374  (-0.373,-0.199) 

Time*  Hartford                             0  0  — 
GA  coverage  during  Period  1 

No                                      0.2083  0.053  (0.085,0.332) 

Yes                                            0  0  _ 
GA  coverage  during  Period  2 

No                                      0.0302  0.057  (-0.102,0.163) 

Yes                                            0  0— 
GA  coverage  during  Period  3 

No                                      0.2169  0.0808  (0.029,0.405) 

Yes                                            0  0— 
GA  coverage  during  Period  4 

No                                      1-9280  0.0456      (1.822,2  034) 

Yes                                            0  0- 
GA  coverage  during  Period  5 

No                                        2.5903  0.0756  (2.414,2.766) 

Yes                                            0  0— 
GA  coverage  during  Period  6 

No                                      8.0826  0.1528  (7.727,8.438) 

Yes                                            0  0— 
GA  Stop  code 

Censored/Missing/Other            1.7771  0.0633  (1.630,1.924) 

EmPloved                             -0.4345  0.1682  (-0.826,-0.043) 

0theraid                               -1.0264  0.1739  (-1.431,-0.622) 

Non  compliance                            0  0  1 

Scale  Q.4609 

According  to  this  model,  the  Hartford  GA  access  rate  increased  1 .33  times  faster 
than  the  New  Haven  rate.  While  Hartford  may  have  been  more  effective  at  opening  its 
doors  to  GA  clients,  that  does  not  necessarily  mean  that  the  clients  it  enrolled  actually 
needed  services.  This  question  is  explored  in  the  next  section. 
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2.  Target  Efficiency  Analysis 

Below,  I  will  explore  the  target  efficiency  of  these  initial  DMHAS  contacts.  If  the 
initial  treatment  or  screening  was  actually  needed,  then  I  would  expect  to  see  further 
DMHAS  contact  within  30  days  after  that  initial  day  of  contact  or  an  initial  assignment 
length  greater  than  one  day.  This  is  a  single  outcome  stemming  from  the  1,748  New 
Haven  contacts  and  the  2,154  Hartford  contacts.  As  discussed  in  Chapter  4,  this  can  be 
easily  modeled  through  relative  risk  regression  using  SAS's  Proc  GENMOD. 

Of  course,  this  measure  fails  to  capture  subjects  who  were  not  successfully 
engaged  in  the  treatment  process,  but  probably  would  have  benefited  from  services,  or 
those  that  simply  miss  their  appointments  within  the  first  month.  Other  subjects  may 
have  been  appropriately  referred  to  outside  care. 

Target  efficiency  varies  by  intake  site.  The  New  Haven  GAP  had  two  screening 
units  in  two  different  locations — one  for  the  substance  abuse  clinic  and  one  for  the 
collocated  site.  The  substance  abuse  screens  were  performed  at  the  New  Haven  LMHA's 
substance  abuse  clinic  located  at  a  separate  campus.  The  collocated  site  had  both 
substance  abuse  and  mental  health  workers,  though  sometimes  staff  from  the  collocated 
site  would  perform  screens  at  the  LMHA.  The  Hartford  GAP  is  equivalent  to  the 
collocated  unit  of  the  New  Haven  GAP,  but  with  clinicians  more  specialized  in  mental 
health  problems. 

The  Hartford  site  expected  most  of  the  GA  substance  abuse  caseload  to  be 
screened  and  managed  by  Hartford  City  GA  Caseworkers.  This  intake  location  is 
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captured  in  the  Intake  Unit  variable,  which  also  includes  all  other  parts  of  the  DMHAS 
system  in  the  'Other'  level. 

A.  One  way  frequencies  and  models 

Unadjusted  frequencies  are  presented  below  in  Table  6-9  and  Table  6-10. 

Descriptions  of  these  variables  and  their  general  information  on  their  categorization  are 
described  in  Chapter  4.  Overall,  38.9%  (837/2154)  of  the  Hartford  sample,  and  47.1% 
(824/1748)  of  the  New  Haven  sample  had  follow-up  DMHAS  care. 

Variables  describing  GA  history  in  the  Access  analysis  (enrollment  in  each 
period,  maximum  number  of  GA  episodes,  and  Start  and  Stop  codes)  were  dropped  in 
favor  of  the  more  proximal  measure  of  severity  -  diagnostic  group.  The  bias  caused  by 
missing  demographic  data  is  expected  to  be  very  high,  as  clients  without  follow-up  care 
only  had  one  chance  to  get  that  information  recorded.  Ancillary  demographic  variables 
in  the  DMHAS  database  (Education,  Marital  Status,  Language)  were  dropped  due  to  high 
rates  of  missing  data  (greater  than  30%).  Imputing  missing  New  Haven  age  values 
(missing  rate  was  25%)  with  the  same  procedure  as  used  in  the  Access  analysis  increased 
the  parameter  estimate  predicting  follow-up  care  by  a  factor  often  (from  0.0014  to 
0.01 1 1).  Therefore,  age  will  not  be  included  in  the  New  Haven  model.  Racial  categories 
similar  to  the  ones  used  in  the  Hartford  Access  analysis  were  created  for  the  New  Haven 
data  set  from  the  DMHAS  demographic  system.  Since  the  rate  of  missing  data  for  New 
Haven  was  nontrivial,  it  was  kept  as  a  separate  level. 
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Table  6-9:  Hartford  unadjusted  efficiency  estimates 


Variable 


Diagnosis 

Missing 
Other 
SA 
MISA 
Axis  1 

GA  status  at  intake 

OffGA 
OnGA 
Intake  Unit 

GAP  Collocated  Site 
GAP  Substance  Abuse  Site 
Other 

Period  of  Intake 

1 
2 
3 
4 
5 
6 

GAP  Pre/Post  (Period  Summary 

Pre 
Post 

Race/Ethnicity 

Missing 

Black,  Non-Hispanic 

Hispanic 

Other 

White,  Non-Hispanic 

Sex 

Missing 

Female 

Male 

Age 

Continuous 
Follow-up  care 
No  Follow-up  care 


Total     No  with  Outcome  % 
Outcome 


RR 


Pval 


1179 

4 

0.34% 

0.00 

0.0001 

110 

71 .43% 

0.83 

0.0013 

COO 

OoZ 

509 

87.46% 

1.01 

0.7398 

oy 

67 

97.10% 

1.12 

0.0016 

I  fU 

147 

86.47% 

1.00 

JO  J 

74.50% 

2.52 

0.0001 

1707 

504 

29.53% 

1.00 

1479 

200 

13.52% 

0.14 

0.0001 

675 

637 

94.37% 

1.00 

39 

38 

97.44% 

1.41 

0.0001 

51 

45 

88.24% 

1.28 

0.0001 

751 

176 

23.44% 

0.34 

0.0001 

279 

155 

55.56% 

0.80 

0.0005 

612 

131 

21.41% 

0.31 

0.0001 

422 

292 

69.19% 

1.00 

1-2  v  3-6) 


90 

83 

92.22% 

2.28 

0.0001 

2064 

754 

36.53% 

1.00 

12 

6 

730 

326 

44.66% 

0.95 

0.4820 

1114 

372 

33.39% 

0.71 

0.0001 

35 

9 

25.71% 

0.55 

0.0396 

263 

124 

47.15% 

1.00 

1 

1 

843 

281 

33.33% 

0.79 

0.0001 

1310 

555 

42.37% 

1.00 

Mean  StdDev 

837 

37.83 

10.79 

0.99 

0.0001 

1317 

35.13 

9.62 

Table  6-10:  New  Haven  unadjusted  efficiency  estimates 


Variable 

— —  ;  

Total 

No  with 
Outcome 

Outcome  % 

RR 

Pval 

Diagnosis 



Missing 

758 

9 

1.19% 

0.01 

0.0001 

l"**U 

other 

194 

140 

72.16% 

0.81 

0.0001 

on 

534 

446 

83.52% 

0.94 

0.0376 

IVI 1 0/A 

76 

63 

82.89% 

0.93 

0.2029 

Avic  1 

186 

166 

89.25% 

1.00 

om  sidiuS  at  iniaKG 

Of  f  f^A 

378 

281 

74.34% 

1.88 

0.0001 

1370 

543 

39.64% 

1.00 

intake  Unit 

oak  ooiiocatea  Site 

339 

193 

56.93% 

0.71 

0.0001 

GAP  Substance  Abuse  Site 

699 

59 

8.44% 

0.10 

0.0001 

Other 

710 

572 

80.56% 

1.00 

Period  or  Intake 

1 

99 

75 

75.76% 

1.68 

0.0001 

2 

115 

84 

73.04% 

1.62 

0.0001 

3 

458 

233 

50.87% 

1.13 

0.1328 

4 

273 

105 

38.46% 

0.85 

0.1221 

5 

532 

205 

38.53% 

0.86 

0.0726 

6 

271 

122 

45.02% 

1.00 

l>ap  Pre/Post  (Period  Summary 

1-2  v  3-6) 

Pre 

214 

159 

43.35% 

1.71 

0.0001 

Post 

1534 

665 

74.30% 

1.00 

Race/Ethnicity 

Missing 

76 

5 

6.58% 

0.11 

0.0001 

I  _  _ ■      hi  it* 

Black,  Non-Hispanic 

862 

338 

39.21% 

0.65 

0.0001 

Hispanic 

412 

240 

58.25% 

0.97 

0.6559 

Other 

74 

47 

63.51% 

1.06 

0.5520 

White,  Non-Hispanic 

324 

194 

P.P.0L 

JJ.OO  /0 

l  .UU 

Sex 

Missing 

3 

1 

33.33% 

Female 

578 

310 

53.63% 

1.22 

0.0001 

Male 

1167 

513 

43.96% 

1.00 

Age-  Continuous 

With  missing  values 

Mean 

StdDev 

Follow-up  care 

696 

33.77 

10.17 

1.00 

0.6292 

No  Follow-up  care 

622 

33.53 

8.96 

Imputed 

Follow-up  care 

824 

28.52 

15.40 

1.01 

0.0001 

No  Follow-up  care 

924 

22.57 

17.37 

Results  from  two  variables,  Period  and  Diagnosis,  are  especially  interesting.  Both 
data  sets  show  a  trend  of  decreasing  efficiency  over  time,  followed  by  a  rise  in  the  last 
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period  (which  is  not  significant  in  New  Haven).  Note  the  drastic  change  in  relative  risk 
between  Hartford's  Period  3  and  Period  4,  when  the  program  was  being  implemented, 
and  Period  5  and  Period  6,  when  the  original  client  recruitment  method  was  reinstated. 
This  pattern  suggests  that  the  increase  in  efficiency  was  due  to  program  maturation, 
rather  than  an  underlying  change  in  severity  of  the  GA  enrollee  pool. 

Despite  these  changes  in  Period  effects  post  GAP  implementation,  there  is  a  clear 
drop  in  accuracy  of  DMHAS's  intake  process  for  clients  who  have  received  GA  benefits. 
However,  a  six  level  period  effect  was  too  many  strata  for  multivariate  modeling  of  such 
small  samples.  A  two  level  GAP  Pre/Post  variable  was  made  that  contrasts  all  incident 
treatment  occurring  in  Periods  1  and  2  with  incident  treatment  occurring  within  Periods 
3-6. 

The  second  interesting  variable  is  Diagnosis.  Not  only  is  the  number  of  people 
with  a  missing  diagnosis  a  large  part  of  each  data  set  (55%  in  Hartford,  and  44%  in  New 
Haven),  but  their  likelihood  of  follow-up  care  is  extremely  small.  These  missing 
categories  probably  represent  subjects  with  no  clinical  needs,  or  subjects  who  seemed  so 
obviously  unimpaired  that  they  were  not  administered  an  entire  screening.  Further, 
Hartford's  percentage  of  sample  that  were  diagnosed  as  substance  abusers  was  not  much 
lower  than  New  Haven's  (26%  v.  31%),  and  was  higher  than  its  intake  practices  and 
proscribed  mission  suggested. 

B.  Target  Efficiency  model  selection 

As  with  the  access  analysis,  multivariate  models  with  all  variables  will  be 

presented,  followed  by  efforts  to  reduce  the  models  to  only  variables  with  explanatory 
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power.  Multivariate  modeling  proceeded  in  a  backwards  fashion  with  all  main  effects, 
and  then  forwards  to  check  for  interactions.  The  results  are  presented  below. 


Table  6-11:  Hartford  and  New  Haven  base  efficiency  models 


Hartford 

New  Haven 

Estimate 

o  lu  err 

rr>uni 

Estimate 

StdErr 

Pr>Chi 

INTERCEPT 

-0.0501 

U.UJJ  1 

u .  oyoo 

n  ne  1 7 

n  m on 

0.1 126 

Diagnosis 

Missing 

-2.1998 

U.UJUJ 

n  nnm 

n  nnn  a 

0.0001 

Other 

-0.0579 

0.0449 

0.1978 

U.  I  too 

U.Uff  f 

n  nnno 
u.uuuy 

SA 

-0.0139 

0.0362 

0.7000 

-0.0493 

U.UO*ru 

n  1  si  1 

MISA 

0.0240 

0.1472 

0.8706 

-0.0442 

0.0570 

n  4*377 

Axis  1 

0.0000 

0.0000 

0  0000 

n  nnnn 

U.UUUU 

GAP  Pre/Post  (Period  summary  1-2  v  3-6) 

Pre 

0.0224 

0.1096 

U.OOO*T 

~U.U/ 

n  moe 

n 

u.UO/1 

Post 

0.0000 

n  nnnn 

U.UUUU 

0.0000 

GA  status  at  intake 

Off  GA 

-0.0081 

o  man 

u.o  i  i  y 

n  nT3C 

u.Uooo 

n  07on 

On  GA 

0.0000 

n  nnnn 

n  r\nr\r\ 
U.UUUU 

n  nnnn 

U.0000 

Intake  Unit 

GAP  Mental  Health  Screen 

-0.1472 

0.0393 

0.0002 

0.0063 

0.0348 

0.8556 

GAP  Substance  Abuse  Screen 

0.1071 

0.0623 

0.0857 

Other 

0.0000 

0.0000 

0.0000 

0.0000 

Race/Ethnicity 

Missing 

-0.0515 

0.3572 

0.8853 

Black,  Non-Hispanic 

-0.0109 

0.0495 

0.8255 

-0.0724 

0.0327 

0.0268 

Hispanic 

-0.0110 

0.0488 

0.8208 

-0.0087 

0.0343 

0.8007 

Other 

-0.0417 

0.1274 

0.7435 

-0.0841 

0.0665 

0.2062 

White,  Non-Hispanic 

0.0000 

0.0000 

0.0000 

0.0000 

Sex 

Female 

0.0158 

0.0285 

0.5783 

0.0039 

0.0310 

0.9005 

Male 

0.0000 

0.0000 

0.0000 

0.0000 

Age 

Continuous 

-0.0004 

0.0018 

0.7988 

The  above  table  shows  multivariate  models  with  all  variables  included.  The 
following  table  is  more  useful  in  identifying  which  variables  affect  target  efficiency. 
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0  0  0 


Table  6-13:  Hartford  Efficiency  model  confounding  check 

Parameter  Bali         GA  Rlcl/  §el  Age  GA  status  at 

 Pre/Post  Ethnicity    intake 

INTERCEPT  -0.0457    -0.0588  100309  -0.0554  -0.0278  .0.0379 

Intake  Unit 

GAP  Collocated  Site  -0.2476    -0.2016  -0.2465  -0.2482  -0.2426  -0.2550 

Other  00  0 
Diagnosis 

Missin9  -2-6137    -2.3997  -2.6085  -2.6066  -2.6137  -2.6105 

0ther  -0-1009    -0.0818  -0.1011  -0.0960  -0.1017  -0.1013 

SA  -0-0266    -0.0226  -0.0268  -0.0218  -0.0267  -0.0256 

MISA  0.0457     0.0269  0.0309  0.0375  0.038  0  0379 

A™  1  0     0  0  0  0  0 
GAP  Pre/Post  (Period  Summary  1-2  v  3-6) 

Pre  0.0319 
Post  0 
Race/Ethnicity 

Black,  Non-Hispanic  -0.0179 
Hispanic  -0.0154 
Other  -0.0701 
White,  Non-Hispanic  0 
Sex 

Female  00179 
Male 
Age 

Continuous 
GA  status  at  intake 

OffGA 
OnGA 


0 


-0.0005 


-0.0161 
0 
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Table  6-12:  Change  in  deviance  tests  for  efficiency  model  building 


Hartford 

New  Haven 

Model 

DF 

-2  LL 

Pval 

Model 

DF 

-2  LL 

Pval 

All  Main  Effects 

2128 

930.12 

All  Main  Effects 

1731 

1077.56 

Diagnosis 

2132 

2247.20 

6.60E-284 

Diagnosis 

1735 

1537.39 

3.25E-98 

GAP  Pre/Post 

2129 

926.95 

1 

GA  status  at  intake 

1732 

1075.05 

1 

GA  status  at  intake 

2129 

929.85 

1 

GAP  Pre/Post 

1732 

1080.48 

0.087526 

Intake  Unit 

2129 

1046.82 

3.35E-27 

Intake  Unit 

1733 

1005.73 

1 

Race/Ethnicity 

2131 

928.71 

1 

Race/Ethnicity 

1735 

1078.99 

0.839332 

Sex 

2129 

927.81 

1 

Sex 

1732 

1073.23 

1 

Age 

2129 

929.49 

1 

Table  6-12  presents  change  in  deviance  tests  contrasting  a  model  with  all  main 


effects  with  models  with  the  variable  of  interest  removed.  Only  the  boldfaced  variables 
are  retained.  The  P  values  indicates  the  significance  of  x2  tests  comparing  the  change  in 
-2  log  likelihood  (-2LL  in  the  table)  and  change  in  total  Degrees  of  freedom  between 
models.  Wften  the  change  in  deviance  was  less  than  zero,  probability  was  assumed  to 
equal  1.  The  next  two  tables  present  evidence  on  potential  confounders.  Confounded 
estimates  are  boldfaced. 
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Table  6-14:  New  Haven  Efficiency  model  confounding  check 
Parameter 


Estimate 

GAP 

GA  status 

Intake 

Sex 

Race/ 

Pre/Post 

at  intake 

Unit 

Ethnicity 

-0.1138 

-0.1003 

-0.0998 

-0.1233 

-0.1178 

-0.0773 

-4.3171 

-4.3300 

-4.3297 

-2.3315 

-4.3149 

-3.0600 

-0.2125 

-0.2053 

-0.2095 

-0.1618 

-0.2124 

-0.2093 

-0.0667 

-0.0610 

-0.0687 

-0.0618 

-0.0645 

-0.0645 

-0.0738 

-0.0671 

-0.0777 

-0.0598 

-0.0721 

-0.0558 

0 

0 

0 

0 

0 

0 

INTERCEPT 
Diagnosis 

Missing 
Other 
SA 
MISA 
Axis  1 

GAP  Pre/Post  (Period  Summ 

Pre  -0.0907 
Post  0 
GA  status  at  intake 

Off  GA  -0.0373 
On  GA  0 
Intake  Unit 

GAP  Collocated  Site  0  038 

GAP  Substance  Abuse  Site  0  123 

Other 
Sex 
Female 
Male 

Race/Ethnicity 

Missing 

Black,  Non-Hispanic 
Hispanic 
Other 


0 


0.0072 
0 


0.1418 
-0.0797 
0.0013 
-0.1146 

White,  Non-Hispanic    0 


Table  6-13  and  Table  6-14  indicate  the  GA  Pre/Post  variable  confounds  the 
Hartford  model,  and  the  Intake  Unit  and  Race/Ethnicity  unit  confound  the  New  Haven 
Model.  The  final  models  for  each  site  are  presented  below. 
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The  Hartford  GAP  intake  unit  is  1.22  times  less  likely  to  intake  subjects  who  get 
follow-up  services  than  other  DMHAS  entry  portals.  The  New  Haven  intake  unit 
variable,  which  was  only  included  in  the  model  because  it  negatively  confounded  the 
Diagnosis  variable,  shows  that  subjects  accessing  DMHAS  through  the  GAP  substance 
abuse  portal  are  1.15  times  more  likely  to  get  follow-up  care  than  those  accessing 
DMHAS  through  non  GAP  entry  portals. 

Race/ethnicity  was  also  a  negative  confounder  of  diagnosis  in  New  Haven. 
Though  Non-Hispanic  Blacks  in  New  Haven  are  significantly  less  likely  to  receive 
follow-up  services  than  non-Hispanic  Whites,  the  effect  size  is  trivial  (RR=1.08). 

Combined  with  the  unadjusted  period  effects  presented  in  Table  6-9  and  Table 
6-10,  the  final  models  paint  a  positive  picture  about  GAP  performance  in  New  Haven. 
Even  with  the  expectedly  high  (but  unknown)  rate  of  outside  referrals  by  the  New  Haven 
GA,  adjusting  for  diagnosis,  the  follow-up  rate  is  as  good  as,  and  in  some  cases,  slightly 
better  than  the  rest  of  DMHAS.  The  drop  in  probability  of  follow-up  after  GAP 
implementation  does  not  suggest  poor  service  coordination  as  much  as  an  influx  of 
clients  with  a  diagnostic  profile  that  did  not  warrant  follow-up  services. 

In  Hartford,  this  was  less  true.  From  the  unadjusted  period  effects,  we  see  that 
GAP  screening  did  bring  in  a  huge  influx  of  clients  whose  diagnostic  profile  did  not 
warrant  further  treatment,  though  this  effect  eased  off  over  time.  This  easing  was  clearly 
due  in  part  to  the  Hartford  GAP  going  back  to  its  normal  intake  protocol  in  Period  6,  but 
also  perhaps  due  to  more  accurate  referrals  from  city  GA  caseworkers. 

The  lower  follow-up  rate  that  is  attributable  to  the  Hartford  GAP  could  be 
explained  in  two  ways.  First,  the  GAP  may  not  have  been  very  effective  in  coordinating 
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C.  Final  Target  Efficiency  models 


Table  6-15:  Final  RR  regression  target  efficiency  models  for  both  cities 


-2.2998  0.1035  0.0001 

-0.0803  0.0426  0.0595* 

-0.0221  0.0292  0.4502 

0.0259  0.1700  0.8789 

0  0 

-0.2008  0.0325  0.0001 


INTERCEPT 
Diagnosis 

Missing 
Other 
SA 
MISA 
Axis  1 
Intake  Unit 
GAP  Collocated  Site 
GAP  Substance  Abuse  Site 
Other 

GAP  Pre/Post  (Period  Summary  1-2  v  3-6) 

Pro 

Post  0.0333     0.1118  0.7656 

»  0  o 
Race/Ethnicity 

Missing 

Black,  Non-Hispanic 
Hispanic 
Other 

White,  Non-Hispanic 


-2.3397  0.1245  0.0001 

-0.1569  0.0453  0.0005 

-0.0547  0.0319  0.0862 

-0.0483  0.0556  0  3849 

0  0 

0.0337  0.0294  0.2525 

0-1440  0.0570  0  0116 

0  0 


0.0357      0.3486  0.9184 

-0.0725      0.0334  0.0298 

-0.0102      0.0344  0.7659 

-0.0851      0.067  0.2039 
0 


Both  the  Hartford  model  (-2LL=888.0605,  DF=2147)  and  the  New  Haven  model 
(-2LW077.86,  DF=,737)  show  no  significant  period  effect  at  aU,  or  even  effects  of  GA 
statns  at  enro.hnent.  Rather  most  of  the  variation  occurs  among  diagnostic  groups,  and 
across  intake  units. 

In  Hartford,  people  with  no  diagnosis  are  9.97  times  less  likely  to  have  follow-up 
care  after  their  initial  contact  man  people  wrth  Axis  1  disorders.  Differences  between  the 
Axis  1  group  and  the  other  Diagnostic  groups  are  no,  significant.  In  New  Haven,  two 
Diagnostic  groups  have  different  follow-up  profiles  from  the  Axis  1  group.  People  with 
no  diagnosis  are  10.4  times  less  likely  to  have  follow-up  care  and  people  with  an  'Other' 
diagnosis  are  1.2  times  less  likely  to  have  follow-up  care  than  people  with  an  Axis  1 
diagnosis. 
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services  across  DMHAS.  Because  diagnoses  are  accounted  for  in  the  model,  lack  of 
follow-up  should  not  be  blamed  on  the  absence  of  substance  abuse  treatment  capacity  at 
the  GAP  and  the  Hartford  LMHA  (though  they  do  have  services  for  MISA  clients). 
Alternatively,  it  may  be  because  since  the  GAP  focused  on  mental  health  treatment,  and 
GAP  clinicians  and  GA  caseworkers  were  not  able  to  encourage  treatment  compliance 
through  threats  of  benefit  suspension  in  the  way  that  they  can  for  substance  abuse 
treatment  needs. 

However,  the  positive  effect  for  the  New  Haven  GAP  and  the  negative  effect  for 
Hartford  GAP  are  still  tiny  in  comparison  to  the  differences  in  follow-up  care  due  to 
diagnosis.  Further,  the  sites  are  not  as  far  apart  as  the  separate  models  would  suggest. 
When  the  samples  are  combined  and  the  Diagnosis  and  Intake  Unit  variables  are  jointly 
modeled  with  a  Site  indicator  variable,  subjects  from  New  Haven  are  only  1.07  times 
more  likely  to  get  follow-up  care  (95%  CI:  1.03,1.1 1,  model  statistics:  -2LL=  2245.3228, 
DF=3895).  Diagnosis  and  Intake  Unit  negatively  confound  the  relationship  between  Site 
and  follow-up  care— without  accounting  for  these  two  variables,  people  from  New  Haven 
are  1.2  times  more  likely  to  get  follow-up  care.  This  confounding  suggests  that  though 
the  Hartford  GAPs  were  more  successful  than  the  New  Haven  GAP  in  increasing  access, 
many  of  the  extra  cases  they  found  were  diagnostically  inappropriate  for  DMHAS 
treatment.  This  potential  tradeoff  between  Access  and  Efficiency  is  best  interpreted  in 
light  of  qualitative  findings,  and  will  be  revisited  in  the  Discussion  chapter. 
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3.  Modeling  costs  of  care 


The  next  managed  care  decision  point  is  the  Utilization  Decision  point.  As 
previously  discussed,  implementation  of  managed  care  mechanisms  (enhanced  service 
coordination  facilitated  by  case  management  and  better  interagency  contact,  and 
utilization  review)  should  result  in  lower  costs  for  GAP  clients  while  they  are  actively 
receiving  GA  benefits.  This  question  was  explored  through  a  series  of  regressions  of 
average  daily  costs,  with  each  study  subject  modeled  as  a  random  effect.  The  results  of 
this  modeling  process  are  presented  below. 

A.  One  way  frequencies  and  cost  models 

Using  the  sampling  criteria  described  Chapter  4,  all  cohort  subjects  with  any 

history  of  DHMAS  care  were  included  in  this  series  of  analyses.  In  Hartford,  that 
included  3,441  unduplicated  subjects,  and  in  New  Haven,  3,564.  Table  6-16  and  Table 
6-17  display  unadjusted  daily  average  costs  for  subjects  from  Hartford  and  New  Haven. 
As  explained  in  Chapter  4,  the  daily  averages  are  derived  by  summing  the  total  costs 
incurred  in  the  number  of  days  enrolled  on  GA  medical  benefits  in  a  given  period, 
divided  by  the  number  of  days  enrolled  on  GA  in  that  period.  The  process  was  repeated 
for  days  not  enrolled  on  GA  medical  benefits  per  period.  Each  subject  can  have  up  to  one 
observation  per  GA  enrollment  status  nested  within  each  Period,  for  a  total  of  12 
observations  per  client. 

Subject  counts  in  the  two  tables  are  unduplicated  where  possible.  Policy  period 
and  General  Assistance  status  are  repeated,  and  are  presented  as  duplicate  counts.  In  the 
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Diagnosis  variable,  S A  stands  for  any  substance  related  diagnosis,  and  MISA  for  any 
Axis  1  substance  combination.  Costs  estimates  per  variable  level  were  determined  by 
fitting  the  duplicated  subject  counts  into  a  regression  and  including  the  individual  subject 
as  a  random  effect.  No  intercepts  were  fit  in  categorical  models  so  that  confidence 
intervals  could  be  used  to  draw  contrasts  between  levels. 


205 


Table  6-16:  Hartford  unadjusted  daily  average  costs 


Variable 

— 5 — t — it- — 1~ — 
ff  or  subjects 



Estimate 

95%  CI 

Age 

3441 

-0.11 

(-0.15,-0.07) 

Diagnostic  Group 

Missing 
Other 

Substance  Abuse 

MISA 

Axis  1 

1645 
148 

1011 
253 
384 

0.49 

I  .Uo 

1.47 
12.23 

V  U.  Io,  1.1UJ 

(-0.74,  2.80) 
(in  on  i*j  sn 

l  I  U.3U,   I  0.00 ) 
(0.4<d,  O.Ol) 

Education 

Missing/unknown 
Less  than  GED 
GED  or  more 

812 
1450 
1179 

0.50 
2.91 
4.04 

(-0.44,  1.45) 
(3.34,  4.74) 

GA  status  (duplicated) 

Off 
On 

8071 

4.05 

(3.50,  4.59) 

6981 

1.53 

(0.96,  2.09) 

Number  of  total  GA  episodes 

1 
2 

3+ 

1707 
902 
832 

3.33 
2.33 
2.36 

(2.73,  3.92) 
(1.49,  3.17) 
(1.50,  3.23) 

Language 

Missing 
Other 
Spanish 
English 

959 
24 
985 
1473 

1.37 

O  AA 

8.00 
1.74 
4.41 

(0.57,  2.18) 
(3.17,  12.83) 
(0.95,  2.53) 
(3.77,  5.05) 

Marital  status 

Missing 
Never  Married 
Married/Cohabiting 
Widowed,  Separated, 
Divorced 

752 
1470 
302 
917 

0.24 
4.19 
2.53 
2.47 

(-0.76,  1.23) 
(3.56,  4.82) 
(1.17,  3.89) 
(1.67,3.27) 

Koiicy  Period  (duplicated  count) 

1 
2 
3 
4 
5 
6 
7 

554 
551 
713 
2746 
2800 
3798 
3890 

9.03 
5.21 
6.75 
3.53 

2.04 
2.07 

(7.14,  10.91) 
(3.33,  7.09) 
(5.09,  8.40) 
(2.67,  4.39) 

(1.40,  0.14) 

(1.32,2.77) 
(1.35,2.78) 

Race 

Missing 

Black,  Non-Hispanic 

Hispanic 

Other 

White 

17 
1311 
1600 
52 
461 

3.57 
2.05 
2.47 
3.30 

(2.88,  4.25) 
(1.42,  2.68) 
(-1.02,  5.96) 
(2.19,  4.41) 

Sex 

Missing 
Women 
Men 

2 

1328 
2111 

2.51 
3.05 

(1.84,  3.19) 
(2.50,  3.59) 

Table  6-17:  New  Haven  unadjusted  daily  average  costs 


Variable 

#  of  subjects 

Estimate 

95%  CI 

Age 

With  missing  values 

2580 

-0.05 

(-0.09,  -0.02) 

Imputed 

3564 

-0.05 

(-0.09,  -0.02) 

Diagnostic  Group 

Missing 

1116 

0.78 

(0.24,  1.31) 

Other 

281 

1.02 

(0.04,  2.01) 

Substance  Abuse 

1412 

1.19 

(0.76,  1.62) 

MISA 

300 

5.32 

(4.41,6.23) 

Axis  1 

455 

3.65 

(2.89,  4.40) 

Education 

Missing/unknown 

867 

1.69 

(1.05,2.33) 

Less  than  GED 

1195 

1.32 

(0.85,  1.79) 

GED  or  more 

1502 

2.21 

(1.78,2.63) 

GA  status  (duplicated) 

Off 

11614 

2.15 

(1.80,2.49) 

On 

8991 

1.34 

(0.95,  1.72) 

Number  of  total  GA  episodes 

1 

1847 

1.97 

(1.57,  2.37) 

2 

944 

1.91 

(1.37,  2.46) 

3+ 

773 

1.22 

(0.63,  1.82) 

Language 

Missing 

1528 

1.17 

(0.75, 1.59) 

Other 

10 

26.25 

(21.09,31.40) 

Spanish 

415 

0.22 

(-0.58, 1.02) 

English 

1611 

2.67 

(2.25,  3.08) 

Marital  status 

Missing 

829 

1.14 

(0.49, 1.79) 

Never  Married 

1676 

2.24 

(1.84,  2.64) 

Married/Cohabiting 

229 

1.67 

(0.59,  2.75) 

Widowed,  Separated, 

830 

1.41 

(0.84,  1.98) 

Divorced 

Policy  Period  (duplicated  count) 

1 

1340 

2.38 

(1.48,  3.29) 

2 

1628 

3.56 

(2.74,  4.39) 

3 

2050 

3.27 

(2.53,  4.01) 

4 

3370 

2.10 

(1.52,  2.69) 

5 

3406 

1.58 

(1.00,  2.15) 

6 

4746 

1.40 

(0.91,  1.89) 

7 

4065 

0.81 

(0.28,  1.33) 

Race 

Missing 

719 

0.71 

(-0.01,  1.43) 

Black,  Non-Hispanic 

1277 

2.24 

(1.78,2.70) 

Hispanic 

693 

0.70 

(0.08,  1.32) 

Other 

109 

5.45 

(3.77,  7.12) 

White 

766 

2.28 

(1.70,  2.86) 

Sex 

Missing 

712 

0.65 

(-0.22,  1.52) 

Women 

1058 

1.75 

(1.26,2.25) 

Men 

1794 

2.02 

(1.65,  2.40) 

The  95%  confidence  intervals  help  determine  if  the  large  portion  of  missing  data 
overwhelm  the  variance  in  other  categories  enough  to  warrant  dropping  the  variable  from 
further  analyses.  This  was  the  case  with  Education  and  Marital  Status  in  Hartford,  and 
Education,  Marital  Status,  and  Sex  in  New  Haven.  Due  to  the  presence,  but  low  rate,  of 
missing  data  among  the  Hartford  Race  and  Sex  variables,  those  missing  values  were  left 
blank,  and  their  observations  were  effectively  dropped  from  the  analysis  whenever  the 
variables  were  included  in  a  model. 

Due  to  high  rates  of  missing  dates  of  birth  in  the  New  Haven  data  set  (30%),  age 
at  start  of  follow-up  was  examined  for  imputation.  When  age  was  imputed  by  using  the 
same  technique  and  means  as  in  prior  analyses,  its  results  were  only  3.4%  higher  than  the 
parameter  estimate  only  among  clients  with  no  missing  data.  To  avoid  dropping  30%  of 
the  sample,  imputed  age  will  be  used  for  model  building. 

B.  Costs  model  selection 

From  this  point,  the  main  effects  of  the  remaining  variables  for  each  site  were 

modeled  in  a  backwards  stepwise  process.  As  discussed  in  Chapter  4,  costs  while 
enrolled  on  GA  medical  benefits  and  costs  while  off  GA  were  modeled  separately  to 
avoid  bias  from  multiple  repeated  factors  (period  and  GA  status).  Results  of  the 
unadjusted  models  are  presented  below. 
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Table  6-18:  Hartford  base  cost  models 


Hartford  Non-GA  Costs 

Hartford  GA  Costs 

Parameter 

Estimate 

StdErr 

Pr>|t| 

Estimate 

StdErr 

Pr>|t| 

INTERCEPT 

16.4688 

2.1276 

0.0001 

4.0799 

1.3837 

0.0032 

Period 

1 

5.3637 

1.5215 

0.0004 

4.1402 

0.9833 

0.0001 

2 

0.8933 

1.5499 

0.5644 

2.9874 

0.8845 

0.0007 

3 

3.2737 

1.4429 

0.0233 

2.6583 

0.7293 

0.0003 

4 

0.7391 

0.9615 

0.4421 

1 .4307 

0.3764 

0.0001 

5 

-0.5344 

0.9083 

0.5563 

0.2702 

0.3675 

0.4623 

6 

-0.5569 

0.8421 

0.5084 

0.4807 

0.3095 

0.1205 

7 

0.0000  . 

0.0000  . 

Race 

Black,  Non-Hispanic 

0.5143 

1.0687 

0.6304 

0.7590 

0.7451 

0.3084 

Hispanic 

0.2818 

1.2627 

0.8234 

1.0383 

0.8517 

0.2229 

Other 

0.8280 

3.2089 

0.7964 

0.8068 

2.0254 

0.6904 

White 

0.0000  . 

0.0000  . 

Diagnostic  Group 

Missing 

-8.0683 

1.1167 

0.0001 

-4.6811 

0.7661 

0.0001 

Other 

-7.9838 

1.7488 

0.0001 

-5.1446 

1.3092 

0.0001 

Substance  Abuse 

-8.1645 

1.1646 

0.0001 

-4.3168 

0.8340 

0.0001 

MISA 

4.3915 

1.4369 

0.0023 

2.8097 

1 .0883 

0  0099 

Axis  1 

0.0000  . 

0.0000  . 

Number  of  GA  Episodes 

1 

-2.0441 

0.9358 

0.0290 

2.4653 

0.5829 

0.0001 

2 

-1.7675 

1.0578 

0.0948 

1.5497 

0.6340 

0.0146 

3+ 

0.0000  . 

0.0000  . 

Language 

Missing 

-3.8681 

0.9039 

0.0001 

-1.1817 

0.5987 

0.0485 

Other 

0.0443 

3.8951 

0.9909 

8.6866 

3.1017 

0.0051 

Spanish 

-2.6673 

1.2202 

0.0289 

-0.8672 

0.7614 

0.2548 

English 

0.0000  . 

0.0000  . 

Sex 

Female 

-0.6744 

0.7611 

0.3756 

-0.1367 

0.4801 

0.7758 

Male 

0.0000  . 

0.0000  . 

Age 

-0.1114 

0.0381 

0.0035 

-0.0338 

0.0237 

0.1549 

Table  6-19:  New  Haven  base  cost  models 


New  Haven  Non-GA  Costs 

New  Haven  GA  Costs 

Variable 

Estimate 

StdErr 

Pr>W 

Estimate 

StdErr 

Pr>|t| 

Intercept 

4.6245 

1.6941 

0.0064 

2.4590 

1.2170 

0.0434 

Period 

1 

2.9375 

0.9521 

0.0020 

1.5044 

0.5153 

0.0035 

2 

3.4652 

0.9457 

0.0003 

1.8157 

0.4711 

0.0001 

3 

5.5677 

0.9107 

0.0001 

1.3654 

0.4291 

0.0015 

4 

2.0324 

0.8460 

0.0163 

1.5596 

0.3617 

0.0001 

5 

1.8115 

0.6943 

0.0091 

0.7672 

0.3650 

0.0356 

6 

0.4750 

0.6575 

0.4700 

0.5997 

0.3214 

0.0621 

7 

0.0000  . 

0.0000  . 

Race 

Missing 

1.6796 

1.5281 

0.2718 

1.0416 

0.8494 

0.2202 

Black,  Non-Hispanic 

0.4136 

0.7160 

0.5635 

0.5599 

0.5281 

0.2892 

Hispanic 

-1.2366 

1.0109 

0.2213 

0.7284 

0.7856 

0.3539 

Other 

4.9630 

1.6423 

0.0025 

4.6545 

1.2681 

0.0002 

White 

0.0000  . 

0.0000  . 

Diagnostic  Group 

Missing 

-2.4767 

1.2186 

0.0422 

-2.2434 

0.7930 

0.0047 

Other 

-3.0916 

1.1076 

0.0053 

-1.3843 

0.9092 

0.1279 

Substance  Abuse 

-2.3096 

0.8056 

0.0042 

-2.1776 

0.6447 

0.0007 

MISA 

3.4395 

1.0908 

0.0016 

-0.1646 

0.8687 

0.8497 

Axis  1 

n  nnon 

u.uuuu  . 

Number  of  GA  Episodes 

1 

0.5334 

0.9168 

0.5607 

0.8745 

0.5006 

0.0808 

2 

-0.3497 

1.0057 

0.7281 

1.7597 

0.5368 

0.0011 

3+ 

0.0000  . 

0.0000  . 

Language 

Missing 

-2.2641 

0.6550 

0.0006 

-0.7009 

0.4870 

0.1501 

Other 

39.3482 

4.6005 

0.0001 

6.4020 

3.9702 

0.1069 

Spanish 

-1.9085 

1.1695 

0.1028 

-2.3829 

0.8964 

0.0079 

English 

0.0000  . 

0.0000  . 

Age 

-0.0588 

0.0331 

0.0757 

-0.0319 

0.0253 

0.2075 

The  contribution  of  each  variable  to  the  base  models  are  more  apparent  with 
multiple  partial  F  statistics.  These  are  presented  below.  Variables  significant  at  the  0.05 
level  are  boldfaced. 
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Table  6-20:  Hartford  costs  model  building 


Hartford  Non-GA  Costs 


Hartford  GA  Costs 


Variable 

DF 

F 

V/a  ria  hi  A 
Vdl  Idulc 

ur 

E 

r 

rPr 

Period 

6 

3.55 

0.0016 

Period 

6 

5.77 

0.0001 

Race 

3 

0.09 

0.9665 

Race 

3 

0.52 

0.6661 

Diagnostic 

4 

37.06 

0.0001 

Diagnostic 

4 

24.02 

0.0001 

Group 

Group 

Number  of  GA 

2 

2.47 

0.0844 

Number  of  GA 

2 

8.94 

0.0001 

Episodes 

Episodes 

Language 

3 

6.27 

0.0003 

Language 

3 

4.28 

0.0050 

Sex 

1 

0.79 

0.3756 

Sex 

1 

0.08 

0.7758 

Age 

1 

8.53 

0.0035 

Age 

1 

2.02 

0.1549 

Table  6-21:  New  Haven  costs  model  building 


New  Haven  Non-GA  Costs 


New  Haven  GA  Costs 


Variable 

DF 

F 

Pr>F 

Variable 

DF 

F 

Pr>F 

Period 

6 

7.85 

0.0001 

Period 

6 

4.26 

0.0003 

Race 

4 

3.63 

0.0059 

Race 

4 

3.47 

0.0077 

Diagnostic 

4 

11.31 

0.0001 

Diagnostic 

4 

4.30 

0.0018 

Group 

Group 

Number  of  GA 

2 

0.85 

0.4269 

Number  of  GA 

2 

5.41 

0.0045 

Episodes 

Episodes 

Language 

3 

29.93 

0.0001 

Language 

3 

3.55 

0.0138 

Age 

1 

3.16 

0.0757 

Age 

1 

1.59 

0.2075 

As  in  the  access  and  target  efficiency  analyses,  I  feel  it  is  easier  to  interpret  these 
models  after  dropping  non  significant  variables.  Different  factors  were  significant  in 
different  models.  The  variables  in  boldface  were  kept  in  all  future  models,  and  the  non- 
boldfaced  variables  were  compared  for  confounding.  These  results  are  presented  below. 
Potential  confounders  are  also  boldfaced. 
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Table  6-22:  Hartford  Costs  models  confounding  check 


I  Ha 

rtford  Non-GA  Costs  j- 

lartford  GA  Costs 

vanauie 

Base 

Sex 

Race 

Number  of 
GA  Episode; 

Base 

Race 

Sex 

Age 

Period 

1 

5.283 

5.305 

5.290 

5.339 

4.147 

4.175 

A  AAA 

4.141 

4.117 

2 

0.794 

0.816 

0.806 

0.865 

2.976 

3.001 

2.968 

3 

3.202 

3.223 

3.220 

3.243 

2.628 

2.665 

2.624 

2.628 

4 

0.721 

0.727 

0.728 

0.728 

1.413 

1.432 

1.411 

1.415 

5 

-0.532 

-0.522 

-0.529 

-0.547 

0.254 

0.262 

0.255 

0.264 

6 

-0.505 

-0.507 

-0.511 

-0.553 

0.483 

0.482 

0.483 

0.481 

7 

0.000 

0.000 

0.000 

0.000 

0.000 

0.000 

0.000 

0.000 

Diaanostic  Gtoud 

Miccinn 

-7.865 

-7.889 

-7.870 

-8.055 

-4.637 

-4.678 

-4.648 

-4.640 

Othpr 

\J  LI  1  CI 

-7.807 

-7.846 

-7.801 

-7.967 

-5.071 

-5.120 

-5.088 

-5.098 

Rithctfinm  Ahuco 

OUUolal  ILC  nUUsc 

-7.789 

-7.936 

-7.757 

-8.057 

-4.220 

-4.205 

-4.268 

-4.311 

MISA 

4.513 

4.373 

4.541 

4.503 

2.929 

2.963 

2.882 

2.793 

Ayic  1 

0.000 

0.000 

0.000 

0.000 

0.000 

0.000 

0.000 

0.000 

uai  iy  uaijc 

Mjccinn 

-3.925 

-4.018 

-3.894 

-3.800 

-1.023 

-1.143 

-1.055 

-1.068 

Other 

-0.142 

-0.134 

-0.085 

0.070 

8.486 

8.586 

8.475 

8.636 

Snanish 

X^uUI  HOI  1 

-2.810 

-2.877 

-2.765 

-2.678 

-0.541 

-1.020 

-0.555 

-0.465 

English 

0.000 

0.000 

0.000 

0.000 

0.000 

0.000 

0.000 

0.000 

Number  of  GA  enisor 

les 

1 

-2.122 

2.236 

2.327 

2.254 

2 

-1.812 

1.441 

1.491 

1.452 

1.506 

3+ 

0.000 

0.000 

0.000 

0.000 

0.000 

Age 

-0.126 

-0.123 

-0.124 

-0.115 

-0.038 

Sex 

Female 

-0.702 

■0.211 

Male 

0.000 

0.000 

Race 

Black,  Non-Hispanic 

0.789 

0.830 

Hispanic 

0.520 

1.208 

Other 

0.768 

0.757 

White 

0.000 

0.000 
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Table  6-23:  New  Haven  Costs  model  confounding  check 


New  Haven  Non-GA  Costs  New  Haven  GA  Costs 


Variable 

Base 

Number  of  GA 
Episodes 

Age 

Base 

Age 

Period 

1 

2.881 

2.901 

2.914 

1.499 

1.504 

2 

3.408 

3.422 

3.449 

1.814 

1.816 

3 

5.545 

5.533 

5.580 

1.366 

1.365 

4 

2.037 

2.003 

2.069 

1.565 

1.560 

5 

1.812 

1.796 

1.829 

0.771 

0.767 

6 

0.483 

0.466 

0.495 

0.605 

0.600 

7 

0.000 

0.000 

0.000 

0.000 

0.000 

Race 

Missing 

1.698 

1.790 

1.583 

1.094 

1.042 

Black,  Non-Hispanic 

0.390 

0.455 

0.343 

0.578 

0.560 

Hispanic 

-1.194 

-1.184 

-1.245 

0.758 

0.728 

Other 

5.042 

5.069 

4.938 

4.673 

4.654 

White 

0.000 

0.000 

0.000 

0.000 

0.000 

Diagnostic  Group 

Missing 

-2.586 

-2.420 

-2.666 

-2.205 

-2.243 

Other 

-3.065 

-3.056 

-3.100 

-1.388 

-1.384 

Substance  Abuse 

-2.294 

-2.203 

-2.408 

-2.139 

-2.178 

MISA 

3.484 

3.485 

3.437 

-0.155 

-0.165 

Axis  1 

0.000 

0.000 

0.000 

0.000 

0.000 

Language 

Missing 

-2.288 

-2.331 

-2.219 

-0.740 

-0.701 

Other 

39.519 

39.514 

39.364 

6.335 

6.402 

Spanish 

-2.123 

-2.110 

-1.933 

-2.490 

-2.383 

English 

0.000 

0.000 

0.000 

0.000 

0.000 

Number  of  GA  Episo 

3SS 

1 

0.439 

0.830 

0.875 

2 

-0.367 

1.755 

1.760 

3+ 

0.000 

0.000 

0.000 

Age 

-0.056 

-0.032 

As  both  tables  indicate,  there  is  no  strong  confounding  in  any  of  the  four  models. 
The  base  model  was  accepted  for  each  one,  and  the  significance  of  a  Period  and 
Diagnostic  Group  interaction  term  was  tested  in  each  model.  As  diagnoses  are  expected 
to  affect  a  client's  course  of  care,  a  significant  interaction  term  would  be  interpreted  as 
evidence  of  effect  modification.  The  multiple  partial  F  tests  that  that  evaluate  the 
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interaction,  along  with  the  other  model  parameters  for  the  final  models,  are  presented 
below. 


Table  6-24:  F  tests  for  final  Hartford  cost  models 


Hartford  Non-GA  Costs 

Hartford  GA  Costs 

Source                DF     Type  III  F  Pr>F 

Source                 DF     Type  III  F  Pr  >  F 

Period                     6       3.10  0.0049 
Diagnostic  Group        4     25.53  0.0001 
Period  Diagnosis       24       1.80  0.0094 
Interaction 

Age                        1      11.35  0.0008 
Language                 3       6.80  0.0001 

Period                    6         5.55  0.0001 
Diagnostic  Group       4       20.39  0.0001 
Period  Diagnosis      24        2.04  0.0020 
Interaction 

Number  of  GA           2         8.03  0.0003 
Episodes 

Language                3         3.54  0.014 

Table  6-25:  F  tests  for  final  New  Haven  cost  models 

New  Haven  Non-GA  Costs 

New  Haven  GA  Costs 

Source   DF     Type  III  F  Pr>F 

Period 

Diagnostic  Group 

Period  Diagnosis 
Interaction 

Race 
Language 


Source 


DF     Type  III  F  Pr>F 


6 
4 
24 


6.58 
17.11 
1.83 


0.0001 
0.0001 
0.0081 


4 

3 


3.30 
29.86 


0.0105 
0.0001 


Period  6  4.45 

Diagnostic  Group  4  4.94 

Period  Diagnosis  24  1.54 

Interaction 
Race  4  3.72 
Language  3  3.92 
Number  of  GA  2  5.43 
 Episodes 


0.0002 
0.0006 
0.0442 

0.0051 
0.0083 
0.0044 


C.  Final  cost  models 

The  F  test  in  all  of  the  above  models  justify  the  inclusion  of  the  Period  Diagnosis 

interaction.  Below,  the  estimates,  standard  errors,  and  probability  of  T  tests  are  presented 
for  each  final  model.  T  tests  are  not  adjusted  for  the  covariance  of  the  interaction  terms, 
so  caution  should  be  used  when  interpreting  them.  In  the  diagnosis  and  interaction  terms, 
SA  stands  for  any  substance  diagnosis,  and  MIS  A  stands  for  any  combination  of  an  Axis 
1  diagnosis  and  a  substance  related  diagnoses. 
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Table  6-26:  Hartford  final  cost  models 


Non  GA  Costs 

GA  Costs 

Effect 

Estimate 

SE 

Pr>|t| 

Estimate 

SE 

Pr>|t| 

INTERCEPT 

11.064 

2.239 

0.0001 

1.589 

1.091 

0.1454 

Period 

1 

17.401 

3.074 

0.0001 

11.774 

2.037 

0.0001 

2 

4.621 

3.026 

0.1268 

8.274 

1.844 

0.0001 

3 

5.725 

2.847 

0.0444 

5.794 

1.527 

0.0001 

4 

6.913 

2.378 

0.0037 

2.924 

1.045 

0.0052 

5 

4.335 

2.376 

0.0680 

1.276 

1.053 

0.2257 

6 

2.828 

2.331 

0.2250 

2.403 

1.023 

0.0189 

7 

0.000 

0.000  . 

Diagnostic  Group 

Missing 

-4.063 

2.020 

0.0443 

-2.202 

1 .069 

Other 

-3.128 

3.238 

0.3341 

-2.730 

1.904 

\J.  IJ  IU 

SA 

-2.939 

2.096 

0.1610 

-2.309 

o  041*; 

MISA 

15.422 

2.698 

0.0001 

4.105 

1  588 

Axis  1 

0.000 

0.000  . 

Period  Diagnosis 

Interaction 

Period  1 'Missing 

-0.174 

6.881 

0.9798 

-10.355 

4.924 

0.0355 

Period  1*Other 

-17.054 

5.486 

0.0019 

-10.791 

3.163 

0.0007 

Period  1*SA 

-15.395 

4.025 

0.0001 

-10.303 

2.660 

0.0001 

Period  1*MISA 

-25.631 

4.644 

0.0001 

-6.457 

3.079 

0.0360 

Period  1  *Axis  1 

0.000 

0.000  . 

Period  2*Missing 

-3.112 

7.501 

0.6783 

-6.058 

3.782 

0.1093 

Period  2*Other 

-4.119 

5.797 

0.4775 

-7.127 

3.014 

0.0181 

Period  2*SA 

-4.568 

4.045 

0.2588 

-6.053 

2.456 

0.0138 

Period  2*MISA 

-10.114 

4.593 

0.0277 

-5.536 

2.744 

0.0437 

Period  2*Axis  1 

0.000 

0.000  . 

Period  3*Missing 

0.172 

5.502 

0.9751 

1.221 

2.524 

0.6288 

Period  3*Other 

-3.386 

5.438 

0.5335 

-4.695 

2.763 

0.0894 

Period  3*SA 

-2.409 

3.859 

0.5324 

-3.704 

2.055 

0.0716 

Period  3*MISA 

-8.488 

4.360 

0.0516 

-3.932 

2.309 

0.0886 

Period  3*Axis  1 

0.000 

0.000  . 

Period  4*Missing 

-5.399 

2.814 

0.0551 

-2.741 

1.171 

0.0193 

Period  4*Other 

-6.434 

4.466 

0.1497 

-0.857 

2.090 

0.6816 

Period  4*SA 

-6.812 

3.058 

0.0260 

-0.326 

1.310 

0.8035 

Period  4*MISA 

-16.414 

3.668 

0.0001 

0.642 

1.713 

0.7079 

Period  4*Axis  1 

0.000 

0.000  . 

Period  5*Missing 

-4.405 

2.798 

0.1155 

-1.429 

1.174 

0.2238 

Period  5*Other 

-4.852 

4.417 

0.2720 

0.017 

2.121 

0  9935 

Period  5*SA 

-5.368 

2.874 

0.0618 

-0.874 

1.267 

0.4906 

Period  5*MISA 

-12.969 

3.634 

0.0004 

-0.542 

1.780 

0.7605 

Period  5*Axis  1 

0.000 

0.000  . 

Period  6*Missing 

-2.909 

2.662 

0.2744 

-2.345 

1.102 

0.0334 

Period  6*Other 

-2.635 

4.356 

0.5453 

-2.090 

2.044 

0.3065 

Period  6*SA 

-4.145 

2.788 

0.1372 

-2.140 

1.188 

0.0718 

Period  6*MISA 

-8.352 

3.559 

0.0190 

0.326 

1.727 

0.8503 

Period  6*Axis  1 

0.000 

0.000  . 

Period  7*Missing 

0.000 

0.000  . 

Period  7*Other 

0.000 

0.000  . 

Period  7*SA 

0.000 

0.000  . 

Period  7*MISA 

0.000 

0.000  . 

Period  7* Axis  1 

0.000 

0.000  . 

Table  6-26  Hartford  final  cost  models  continued 


Non  GA  costs 

GA  Costs 

Effect              Estimate  SE 

Pr>|t| 

Estimate 

SE 

Pr>|t| 

Language 

Missing 

-3.760  0.888 

0.0001 

-1.250 

0.590 

0.0342 

Other 

-0.644  3.703 

0.8619 

6.950 

3.017 

0.0213 

OLJal  llol  1 

-£..10  1  U.OJJ 

0.0019 

-0.546 

0.559 

0.3295 

English 

0.000 

0  000 

Age 

Continuous 

-0.126  0.037 

0.0007 

Number  of  GA 

Episodes 

1 

2.274 

0.568 

0.0001 

2 

1.493 

0.629 

0.0177 

3+ 

0.000 

-2  Log  Likelihood 

76221.04 

54544.92 

Degrees  of  Freedom 

38 

39 

Table  6-27:  New  Haven  final  cost  models 


Non  GA  costs 

GA  Costs 

tnect 

Estimate 

SE 

Pr>|t| 

Estimate 

SE 

Pr>|t| 

Intercept 

2.721 

1.195 

0.0229 

0.048 

1.260 

0.9694 

Period 

1 

2.170 

2.240 

0.3327 

4.529 

1.518 

0.0029 

2 

1.586 

2.226 

0.4761 

4.742 

1.422 

0.0009 

3 

5.436 

2.091 

0.0094 

2.102 

1.348 

0.1188 

4 

3.480 

1.829 

0.0572 

3.366 

1.248 

0.0070 

5 

1.361 

1.548 

0.3791 

2.632 

1.298 

0.0426 

S 

1.690 

1.493 

0.2578 

0.644 

1.181 

0.5855 

7 

0.000 

0.000 

Diagnostic  Group 

Missing 

-1.327 

1.792 

0.4590 

-0.858 

1.299 

0.5090 

Other 

-2.276 

1.739 

0.1908 

-0.254 

1.757 

0.8851 

SA 

-1.607 

1.261 

0.2025 

-0.496 

1.234 

0.6880 

MISA 

0.534 

1.730 

0.7577 

0.687 

1.652 

0.6777 

Axis  1 

0.000 

0.000 

Period  Diagnosis 

Interaction 

Period  TMissing 

-1.792 

3.457 

0.6041 

-3.730 

2.005 

0.0629 

Period  1*0ther 

-1.384 

4.216 

0.7427 

-2.878 

2.482 

0.2464 

Period  1*SA 

-1.070 

2.605 

0.6814 

-3.918 

1.687 

0.0202 

Period  1*MISA 

14.274 

3.672 

0.0001 

-1.291 

2.228 

0.5623 

Period  1  *Axis  1 

0.000 

0.000 

Period  2*Missing 

-0.998 

3.505 

0.7758 

-3.848 

1.828 

0.0353 

Period  2*Other 

-0.485 

3.942 

0.9021 

-0.776 

2.278 

0.7334 

Period  2*SA 

1.673 

2.595 

0.5193 

-3.404 

1.576 

0.0308 

Period  2*MISA 

9.221 

3.563 

0.0097 

-3.944 

2.092 

0.0594 

Period  2*Axis  1 

0.000 

0.000 

Period  3*Missing 

-2.448 

3.425 

0.4749 

0.242 

1.653 

0.8835 

Period  3*Other 

-3.861 

3.514 

0.2720 

1.168 

2.146 

0.5864 

Period  3*SA 

-0.399 

2.474 

0.8719 

-1.816 

1.485 

0.2213 

Period  3*MISA 

7.431 

3.323 

0.0254 

1.789 

1.986 

0.3677 

Period  3*Axis  1 

0.000 

0.000 

Period  4*Missing 

-2.780 

3.313 

0.4015 

-1.983 

1.389 

0.1535 

Period  4*0ther 

-2.652 

3.029 

0.3813 

-2.747 

1.976 

0.1646 

Period  4*SA 

-2.531 

2.228 

0.2560 

-1.913 

1.368 

0.1621 

Period  4*MISA 

1.943 

2.973 

0.5134 

-1.568 

1.818 

0.3883 

Period  4*Axis  1 

0.000 

0.000 

Period  5*Missing 

0.552 

2.557 

0.8290 

-1.777 

1.418 

0.2103 

Period  5*Other 

0.816 

2.560 

0.7501 

-1.613 

2.060 

0.4338 

Period  5*SA 

-0.645 

1.864 

0.7294 

-2.314 

1.424 

0.1042 

Period  5*MISA 

4.969 

2.517 

0.0484 

-2.027 

1.897 

0.2854 

Period  5*Axis  1 

0.000 

0.000 

Period  6*Missing 

-1.464 

2.284 

0.5214 

-0.051 

1.276 

0.9683 

Period  6*Other 

-1.523 

2.448 

0.5339 

-0.499 

1.871 

0.7896 

Period  6*SA 

-1  41R 

U.*K3UU 

-(J.  006 

1.294 

0.9963 

Period  6*MISA 

-1.549 

2.456 

0.5281 

0.376 

1.751 

0.8299 

Period  6*Axis  1 

0.000 

0.000 

Period  7*Missing 

0.000 

0.000 

Period  7*Other 

0.000 

0.000 

Period  7*SA 

0.000 

0.000 

Period  7*MISA 

0.000 

0.000 

Period  7*Axis  1 

0.000 

0.000 

Table  6-27:  New  Haven  final  cost  models,  continued 


Non  GA  costs 

GA  Costs 

Effect 

Estimate 

SE 

Pr>|t| 

Estimate 

SE 

Pr>|t| 

Race 

Missing 

0.611 

fl  71  QQ 

•1   H  Cfl 

1  .IbU 

0.852 

0.1732 

Black,  non-Hispanic 

0.359 

0.713 

0.6141 

U.OZO 

U.ZOOO 

Hispanic 

-1.204 

1.011 

0.2339 

0.777 

n  7S^ 

u.  /  Oo 

Other 

4.957 

1.642 

U.UUtU 

0.0002 

White,  non-Hispanic 

0.000 

0.000 

Language 

Missing 

-2.185 

0.654 

0.0008 

U.*tOO 

u.uyoi 

Other 

39.436 

4.604 

0.0001 

6.285 

3.968 

0.1133 

opanisn 

-2.104 

1.165 

0.0709 

-2.493 

0.892 

0.0052 

English 

0.000 

0.000 

Number  of  GA 

Episodes 

1 

0.790 

0.499 

0.1135 

2 

1.750 

0.536 

0.0011 

3+ 

0.000 

-2  Log  Likelihood 

59726.23 

108592.80 

Degrees  of  Freedom 

37 

39 

As  the  interaction  terms  in  the  above  two  tables  are  difficult  to  interpret,  the  next 
two  tables  present  adjusted  mean  average  daily  costs  for  each  period  by  diagnostic  group 
while  on  GA  and  off  GA.  SA  indicates  a  substance  abuse  diagnosis  and  MSA  indicates 
an  Axis  1  diagnosis  and  a  Substance  abuse  diagnosis. 
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Table  6-28:  Hartford  adjusted  daily  average  costs  by  diagnostic  group 


Hartford  Non-GA  costs 


Hartford  GA  costs 


Period 

Missing 

Other 

SA 

MISA 

Axis  1 

Missing 

Other 

SA 

MISA 

Axis  1 

1 

24.19 

8.25 

10.14 

18.61 

28.86 

0.81 

-0.16 

0.75 

11.01 

13.36 

2 

8.47 

8.40 

8.16 

21.01 

15.82 

1.60 

0.01 

1.50 

8.43 

9.86 

3 

12.83 

10.24 

11.45 

23.69 

16.90 

6.40 

-0.04 

1.37 

7.55 

7.38 

4 

8.47 

8.38 

8.07 

16.87 

18.05 

-0.43 

0.93 

1.88 

9.26 

4.51 

5 

6.88 

7.38 

7.06 

17.83 

15.56 

-0.77 

0.15 

-0.32 

6.43 

2.86 

6 

6.87 

8.09 

6.78 

20.63 

13.99 

-0.56 

-0.83 

-0.46 

8.42 

3.99 

7 

6.95 

7.90 

8.10 

25.30 

11.11 

-0.61 

-1.14 

-0.72 

5.69 

1.59 

Table  6-29:  New  Haven  adjusted  daily  average  costs  by  diagnostic  group 


New  Haven  Non-GA  costs 


New  Haven  GA  costs 


Period 

Missing 

Other 

SA 

MISA 

Axis  1 

Missing 

Other 

SA 

MISA 

Axis  1 

1 

1.77 

1.23 

2.21 

19.70 

4.89 

-0.01 

1.45 

0.16 

3.97 

4.58 

2 

1.98 

1.55 

4.37 

14.06 

4.31 

0.09 

3.76 

0.89 

1.53 

4.79 

3 

4.38 

2.02 

6.15 

16.12 

8.16 

1.54 

3.06 

-0.16 

4.63 

2.15 

4 

2.09 

1.27 

2.06 

8.68 

6.20 

0.57 

0.41 

1.01 

2.53 

3.41 

5 

3.31 

2.62 

1.83 

9.59 

4.08 

0.05 

0.81 

-0.13 

1.34 

2.68 

6 

1.62 

0.61 

1.39 

3.40 

4.41 

-0.22 

-0.06 

0.19 

1.76 

0.69 

7 

1.39 

0.45 

1.11 

3.26 

2.72 

-0.81 

-0.21 

-0.45 

0.74 

0.05 

Because  GA  and  non-GA  costs  from  the  same  city  are  not  from  the  same  model,  it 
is  not  appropriate  to  make  statistical  comparisons  between  the  two,  though  more  informal 
inferences  can  be  drawn.  The  tables  reveal  three  interesting  aspects  about  the  sites. 

One  unusual  aspect  about  the  cost  tables  is  that  some  of  the  GA  costs  are 
negative.  This  is  an  artifact  of  the  models,  and  the  negative  values  do  not  reflect  income 
for  DMHAS,  but  rather  lack  of  statistical  power  in  those  strata  and  the  relative  magnitude 
of  more  precise  estimate  elsewhere  in  the  model. 

Second,  in  Period  5,  the  Hartford  GAP  began  utilization  management  of  LMHA 
ambulatory  services.  There  are  no  obvious  changes  in  costs  between  Period  5  and 
preceding  Periods  that  would  suggest  that  this  management  had  any  effect.  This  finding 
is  not  surprising,  since  inpatient  costs  are  very  likely  to  skew  daily  cost  averages  that  also 
include  the  less  frequent  outpatient  care.  The  GAP  Clinical  Director  approved  all 
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inpatient  stays  herself  since  the  start  of  the  GAP  and  her  supervision  was  in  addition  to 
the  LMHA  wide  inpatient  utilization  management  that  began  in  Period  2. 

Finally,  costs  in  Non-GA  models  tend  to  be  higher  than  costs  in  the  GA  models  at 
the  same  time  period  for  the  same  city,  though  this  difference  is  most  remarkable  for 
Hartford.  GA  costs  and  Non-GA  costs  have  different  intercepts,  and  when  people  are  off 
GA,  they  have  higher  daily  average  costs  then  when  they  are  on  GA.  The  available  data 
can  not  explain  why  this  would  occur,  though  four  reasons  seem  plausible,  and  may 
operate  differently  among  different  diagnostic  groups. 

One  potential  reason  for  the  different  intercepts  is  that  GA  caseworkers  are 
effective  at  helping  GA  clients  negotiate  through  various  treatment  services,  and  improve 
their  quality  of  care  to  the  extent  that  costly  hospitalizations  are  avoided.  This 
explanation  does  not  seem  likely,  because  if  GA  caseworkers  were  so  skilled  at 
coordinating  services,  they  would  have  affected  access  as  well  as  costs. 

Another  reason  for  the  intercept  difference  could  be  that  DMHAS  behavioral 
health  services  are  substitutes  for  physical  health  care  while  subjects  had  no  medical 
coverage.  This  explanation  seems  unlikely  because  of  the  specialized  services  DMHAS 
offers  and  the  training  level  of  DMHAS  staff  that  provide  them,  but  there  is  not  sufficient 
detail  in  the  available  data  to  conclusively  rule  out  this  explanation. 

A  third  reason  could  be  that  GA  medical  benefits  most  often  coincide  with  cash 
payments.  Cash  payments  may  encourage  stability  in  client's  lives,  by  lowering  stress  or 
improving  living  conditions,  or  it  may  allow  clients  to  self-medicate  for  any  behavioral 
health  problems.  In  other  words,  cash  payments  may  lead  to  a  decrease  in  severity  of 
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illness  or  reduction  in  help  seeking  behavior.  This  is  an  interesting  question  that  deserves 
more  study,  but  current  data  prevents  further  exploration. 

The  most  compelling  reason  is  that  when  people  are  on  GA  insurance  benefits, 
they  choose  providers  outside  of  the  DMHAS  system.  When  they  have  no  medical 
benefits,  they  simply  shift  their  locus  of  care  to  the  DMHAS  system  because  it  is  free  to 
them.  Their  baseline  costs  while  on  GA  (the  intercepts)  for  behavioral  health  services 
may  actually  be  equal  to  their  non-GA  baseline  service  costs  when  their  non-DMHAS 
services  are  taken  into  account.  Again  there  is  no  way  to  tell.  At  the  least,  these  models 
do  capture  all  of  the  costs  that  DMHAS  actually  paid  for. 

Regardless  of  these  potential  explanations,  costs  for  DMHAS  services  appear  to 
be  lower  while  clients  have  GA  medical  benefits,  before  and  after  the  GAP.  It  would  be 
unwise  to  attribute  the  overall  difference  (the  intercept)  to  any  GAP  activity. 

The  slopes  of  these  four  models  are  more  informative.  Costs  in  almost  all 
diagnostic  categories  decline  over  time,  though  some  costs  decline  faster  than  others. 
This  is  a  clear  indication  that  the  potential  bias  caused  by  clinicians  under  reporting  client 
contact  was  non-existent,  or  insufficient  to  hide  this  negative  trend.  It  also  suggests  that 
the  entire  DMHAS  system  was  reducing  costs,  and  any  savings  in  the  GAP  may  not  have 
been  due  to  the  GAP,  but  rather  part  of  this  larger  secular  trend.  DMHAS  implemented 
prior  authorization  for  all  inpatient  care  in  Period  2,  prior  to  the  GAP,  and  this  one  policy 
change  may  be  the  sole  reason  for  all  cost  decline. 

This  issue  can  be  explored  by  comparing  the  slopes  of  both  On  GA  and  Off  GA 
costs  after  implementation.  The  GAP  may  have  saved  proportionally  more  money  than 
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non-GA  costs  after  the  GAP  was  implemented,  leading  to  a  greater  negative  slope  for  the 
GAP. 

The  figures  below  graph  the  adjusted  daily  average  GA  and  Non-GA  costs  (in 
dollars)  from  Table  6-16  and  Table  6-17  by  period.  These  graphs  give  some  indication  of 
the  relative  difference  between  slopes  and  intercepts  of  the  two  sets  of  costs  even  though 
they  are  from  different  models.  Because  the  Hartford  GAP  was  not  expected  to  manage 
substance  abuse  costs,  graphs  of  those  costs  will  not  be  shown.  Because  of  the 
extremely  low  follow-up  rates  in  the  missing  diagnosis  category,  these  costs  will  also  not 
be  presented  for  either  city. 
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Figure  6-5:  Hartford  adjusted  Other  diagnosis  costs  by  GA  status 
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Figure  6-6:  Hartford  adjusted  MISA  costs  by  GA  status 
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Figure  6-7:  Hartford  adjusted  Axis  1  costs  by  GA  status 
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Figure  6-9:  New  Haven  adjusted  Axis  1  costs  by  GA  status 


Figure  6-10:  New  Haven  adjusted  substance  abuse  costs  by  GA  status 
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These  graphs  provide  direct  contrasts  between  costs  incurred  by  many  of  the  same 
subjects  in  identical  diagnostic  groups  with  different  payment  sources.  It  is  still  not  easy 
to  tell  if  differences  between  the  two  lines  in  each  graph  are  due  to  differences  in 
intercepts  or  slopes. 

Since  differences  in  slope  are  the  best  indicators  for  a  GAP  effect,  models  were  fit 
with  an  intercept,  the  covariates  from  the  final  cost  models  (as  shown  in  Table  6-28  and 
Table  6-29),  and  Periods  effect  as  a  continuous  variable.  To  further  refine  the  analyses, 
models  were  restricted  to  only  Periods  when  the  GAPs  were  active  (Periods  3-7),  and 
only  among  people  from  an  individual  diagnostic  group.  Confidence  intervals  of  the 
slopes  can  informally  show  if  the  GA  cost  trends  and  the  non-GA  cost  trends  were 
different.  The  results  are  presented  below. 


Table  6-30:  Hartford  GA  and  non-GA  cost  contrasts 


Hartford  continuous  slopes  from  Periods  3  to  7 


Slope 

SE 

95%  CI 

All  Diagnoses 

Non-GA  Costs 

-0.682 

0.239 

(-1.151,-0.213) 

GA  Costs 

-0.530 

0.106 

(-0.738,  -0.323) 

Other  Diagnoses 

Non-GA  Costs 

-0.205 

0.209 

(-0.616,  0.206) 

GA  Costs 

-0.346 

0.198 

(-0.736,  0.044) 

MISA  (Substance  Abuse  and  Axis  1) 

Non-GA  Costs 

1.419 

1.405 

(-1.340,  4.178) 

GA  Costs 

-1.093 

0.779 

(-2.628,  0.441) 

Axis  1 

Non-GA  Costs 

-1.766 

0.702 

(-3.143,  -0.388) 

GA  Costs 

-0.986 

0.469 

(-1.909,  -0.064) 
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Table  6-31:  New  Haven  GA  and  non-GA  cost  contrasts 


New  Haven  continuous  slopes  from  Periods  3  to  7 


Slope 

SE 

95%  CI 

All  Diagnoses  Combined 

Non-GA  Costs 

-0.654 

0.132 

(-0.913,  -0.394) 

GA  Costs 

-0.418 

0.098 

f-0  610  -0  227^ 

Other  Diagnoses 

Non-GA  Costs 

-0.280 

0.282 

(-0.834,  0.274) 

GA  Costs 

-0.790 

0.565 

(-1.902,  0.322) 

Substance  Abuse 

Non-GA  Costs 

-0.423 

0.157 

(-0.731,-0.116) 

GA  Costs 

-0.166 

0.135 

(-0.430,  0.098) 

MIS  A  (Substance  Abuse  and  Axis  1) 

Non-GA  Costs 

-2.184 

0.694 

(-3.546,  -0.823) 

GA  Costs 

-0.567 

0.350 

(-1.255,  0.121) 

Axis  1 

Non-GA  Costs 

-0.622 

0.460 

(-1.525,  0.281) 

GA  Costs 

-0.780 

0.541 

(-1.842,  0.283) 

As  both  sets  of  confidence  intervals  between  all  diagnostic  groups  overlap,  it  is 
doubtful  that  more  formal  statistical  testing  would  find  any  real  difference.  The  reason 
for  such  large  confidence  intervals  are  probably  due  to  relatively  small  sample  sizes 
within  each  strata.  From  these  data,  it  does  not  appear  that  the  GAP  reduced  costs  faster 
than  DMHAS  standard  practices. 

The  effect  sizes,  when  considered  alone,  yield  more  disappointing  news.  The 
only  case  where  the  GAP  seems  most  likely  to  reduce  costs  faster  than  normal  DMHAS 
practice  is  for  Hartford  MISA  clients.  Among  Axis  1  subjects  in  Hartford,  and  among 
Substance  Abuse  and  MISA  subjects  in  New  Haven,  cost  appear  to  decline  faster  when 
the  GAP  is  not  managing  care.  Larger  samples  sizes,  or  more  accurate  statistical  methods 
(such  as  mixed  models  with  repeated  insurance  status  and  period  variables),  may  yield  a 
clearer  picture,  but  it  is  doubtful  that  it  would  be  less  gloomy. 
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To  summarize,  DMHAS  direct  costs  have  decreased  at  GAP  sites  since  the 
implementation  of  the  GAP,  suggesting  some  substitution  of  care  has  occurred.  There  is 
not  sufficient  data  to  judge  the  quality  of  this  substitution. 

It  is  unlikely  that  this  cost  reduction  was  due  to  GAP  managed  care.  DMHAS 
costs  for  GA  funded  and  non  GA  funded  care  declined  at  a  similar  rate  over  the  same 
time  period.  It  seems  that  the  DMHAS  style  of  care  changed  over  time  and  this  practice 
pattern  is  not  sensitive  to  insurance  status.  Change  in  practice  could  be  attributed  to 
DMHAS 's  internal  prior  authorization  program  for  inpatient  services,  or  the  steady 
reductions  in  the  number  of  DMHAS  inpatient  beds  throughout  the  follow-up. 
Regardless,  costs  did  decrease,  and  this  is  a  very  laudable  finding  for  DMHAS  as  a 
whole,  but  calls  the  utility  of  GAP  managed  care  into  question. 

The  apparent  faster  decline  in  non-GAP  services  could  be  a  regression  to  the 
mean  phenomenon,  in  that  non-GA  costs  fell  faster  simply  because  they  had  more  room 
to  drop,  and  the  GAP  had  no  real  affect  on  utilization  at  all.  Or  it  could  be  that  the  GAPs 
purposefully  did  not  let  utilization  intensity  drop  too  far  to  avoid  compromising  quality. 

On  the  other  hand,  it  also  seems  plausible  that  GAP  cost  reductions  were  greatest 
among  GA  funded  non-DMHAS  services.  In  fact,  the  GAPs  may  have  worked  against 
DMHAS 's  general  cost  reduction  trend  by  diverting  some  of  the  client  services  usually 
provided  by  non-DMHAS  providers  into  DMHAS  treatment,  because  DMHAS  was  a 
more  skilled,  cost  effective,  or  convenient  provider. 

From  this  analysis  of  only  DMHAS  treatment,  the  GAP's  theoretical  claim  to 
appropriately  substitute  care  remains  plausible,  though  less  credible.  The  real  answer 
cannot  be  determined  without  utilization  records  from  non-DMHAS  providers. 
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4.  Race  and  Managed  care 

In  previous  chapters,  I  discussed  literature  about  racial  and  ethnic  differences  in 
health  utilization,  and  described  how  they  might  change  under  the  GAP.  The  following 
section  briefly  reviews  the  racial  and  ethnic  disparities  in  the  above  analyses,  and  probes 
for  more  convincing  findings  when  appropriate. 

A.  No  conclusive  differences  in  cost  models 

Though  the  GAP  was  hypothesized  to  standardize  utilization  rates  across  races 

and  ethnicity's,  the  issue  is  moot,  as  the  GAP  had  no  clear  effect  on  utilization.  Race  was 
not  a  significant  predictor  of  costs  in  Hartford  (Table  6-26),  and  though  it  significantly 
contributed  to  the  overall  fit  of  the  New  Haven  costs  models  (Table  6-27),  significant 
differences  from  non-Hispanic  Whites  were  confined  to  the  uninterpretable  "Other" 
category. 

Language  differences  are  stronger,  but  still  ambiguous.  In  Hartford,  Spanish 
speakers  have  significantly  lower  Non-GA  costs  than  English  speakers  (p=.  0019,  see 
Table  6-26),  and  in  New  Haven,  Spanish  speakers  had  significantly  lower  GA  costs  than 
English  speakers  (p=.0052,  see  Table  6-27).  No  other  language  results  were  significant. 
The  consistent  direction  of  these  findings  suggest  Spanish  speaking  clients  use  less 
DMHAS  resources  than  English  speakers,  but  it  is  hard  to  attribute  these  differences  to 
the  GAP  when  the  GAPs'  overall  effects  on  utilization  are  so  weak. 

B.  Race  and  access  to  care  in  Hartford 

The  Hartford  access  model  (Table  6-7)  suggests  that  access  varies  by  race. 

Hispanic  subjects  are  1.35  times  less  likely  to  access  DMHAS  services  than  non-Hispanic 
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Whites,  and  non-Hispanic  Blacks  are  1 .45  less  likely  to  access  DMHAS  services  than 
non-Hispanic  Whites. 

As  Hartford  is  the  only  site  where  this  level  of  information  is  available,  it  is 
impossible  to  definitively  explain  this  effect.  However,  if  implementation  of  the  GAP 
somehow  exacerbated  racial  differences  in  access  rates,  that  would  be  a  clear  cause  for 
concern — for  as  Rosenbaum  and  colleagues  (1997)  have  pointed  out,  a  violation  of 
federal  civil  right  laws  may  have  occurred  if  treatment  of  minority  groups  is  different 
from  the  majority,  regardless  of  intent. 

To  check  to  see  if  the  GAP  contributed  to  any  possible  racial  disparities,  I  fit  a 
Poisson  GEE  model  with  Race,  Period,  and  their  interaction,  and  any  DMHAS  treatment 
as  the  outcome.  To  focus  on  the  GAP  effect,  I  restricted  observations  to  outcomes  that 
occurred  when  GA  benefits  were  active,  and  fit  an  identical  model  on  events  that 
occurred  when  GA  benefits  were  inactive.  I  also  dropped  observations  from  the  'Other' 
race/ethnicity  category  due  to  a  zero  in  one  interaction  cell.  The  linear  predictors  for 
each  racial  group  in  each  period  are  displayed  graphically  below,  with  99%  confidence 
intervals.  To  adjust  the  graphs'  scale,  I  added  5  to  each  linear  predictor. 
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Figure  6-11:  Hartford  unadjusted  race  period  interaction  access 
model,  when  GA  benefits  are  inactive 
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would  suggest.  Based  on  such  weak  results,  it  seems  reasonable  to  conclude  that  the 
GAP  did  not  worsen  racial  access  differentials,  though  some  differentials  may  exist  for 
unknown  reasons. 

Language  and,  in  the  case  of  Hartford,  Race,  did  not  affect  efficiency  of  initial 
DMHAS  contacts  in  any  measurable  way  (see  Table  6-15).  Non  Hispanic  Blacks  were 
significandy  less  likely  to  receive  follow  up  care  than  non-Hispanic  Whites  in  New 
Haven  (p=0.0298),  but  the  magnitude  of  the  finding  (RR=  0.93)  is  inconsequential. 

It  seems  clear  that  the  GAP  had  no  real  effect  on  any  racial  or  ethnic  disparities  in 
access  or  treatment.  This  issue,  along  with  care  substitution,  and  the  access/target 
efficiency  tradeoff,  will  be  revisited  in  the  following  chapter,  and  integrated  with 
findings  from  Chapter  5. 
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Figure  6-12:  Hartford  unadjusted  race  period  interaction  access 
model,  when  GA  benefits  are  active 


Hartford  Unadjusted  Race  P«riod  Interaction  when  GA  benefiti  are  Active,  with  99%  CI 


The  results  of  these  two  graphs  are  not  conclusive.  The  Inactive  GA  graph 
corresponds  to  the  part  of  the  Hartford  cohort  forming  the  lower  line  in  Figure  6-3. 
Hispanics  have  a  significantly  lower  access  rate  than  non-Hispanic  whites  in  Periods  1,  4, 
and  6. 

The  Active  GA  graph  is  drawn  from  the  portion  of  the  Hartford  cohort  forming 
the  upper  line  in  Figure  6-3.  All  minorities  have  significantly  lower  access  rates  in 
Period  3  from  non-Hispanic  Whites,  and  in  Period  6,  non-Hispanic  Blacks  have  a 
significantly  lower  access  rate  than  non-Hispanic  Whites. 

In  all  other  Periods  for  both  graphs,  confidence  intervals  for  each  racial  group 
overlapped,  suggesting  the  race  effect  is  not  as  strong  as  the  Table  6-7  Hartford  model 
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There  is  a  tradeoff  in  the  screening  rate  —the  right  amount  increases  access  to 
care,  but  too  much  is  wasteful.  This  issue  was  explored  by  examining  the  likelihood  of 
follow-up  DMHAS  care  that  the  cohort  received  after  their  initial  contact  at  DMHAS. 

1)  Access/ screening  accuracy  tradeoff 

Since  most  referrals  for  screenings  come  from  GA  caseworkers,  this 
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access/accuracy  tradeoff  may  give  some  insight  into  DMHSA/GA  relations.  In  Chapte 
5, 1  discussed  some  of  the  reported  difficulties  the  Hartford  GAP  site  had  in  working  with 
GA  caseworkers.  Informants  reported  resentment  and  hostility  between  the  two  agency's 
line  staff,  and  GAP  staff  also  complained  that  referrals  from  the  GA  caseworkers  were 
too  few  in  number  and  often  inaccurate.  In  Hartford,  things  got  so  bad  that  during  Period 
5,  the  GAP  broke  protocol  and  pulled  clients  directly  for  screening  from  the  GA  waiting 
area  without  waiting  for  GA  caseworker  referral.  New  Haven  did  not  report  as  much 
hostility  or  complain  about  the  referral  process.  I  attributed  this  difference  in  tension  and 
collaboration  between  the  two  sites  to  Hartford's  lower  intensity  of  collocation.  Client 
level  effects  can  be  attributed  to  this  collocation  intensity  as  well. 

This  difference  in  collocation  intensity  did  not  seem  to  affect  overall  access  to 
care— Hartford's  access  rate  grew  faster  than  New  Haven's.  However,  access  by  itself 
may  not  be  sensitive  to  differences  in  collocation  intensity.  After  all,  both  sites  are 
collocated  to  some  extent,  and  subjects  from  either  site  don't  have  to  travel  far  to  access 
care.  Further,  if  follow-up  services  are  provided  outside  the  welfare  building,  (as  they 
usually  are  in  both  sites),  Hartford  GA  recipients  only  need  to  walk  across  the  street  to 
their  local  LMHA,  whereas  the  New  Haven  welfare  office  is  several  miles  from  their 
LMHA. 
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Chapter  7:  Discussion 

This  dissertation  has  presented  qualitative  and  quantitative  analyses  in  two 
separate  chapters.  However,  the  GA  Pilot  project  (GAP)  demonstrates  that  managed  care 
and  service  integration  techniques  and  effects  can  be  very  similar,  though  the  literature 
and  goals  may  be  different.  This  chapter  will  attempt  to  link  the  two  sets  of  themes  and 
analyses,  and  then  draw  some  general  conclusions  about  the  utility  of  behavioral  health 
authorities  directly  operating  managed  care  programs. 

1 .  The  GAP  as  a  Service  Integration  mechanism 

A.  Interagency  aspects  of  the  GAP 

The  GAP's  first  challenge  was  to  improve  or  maintain  the  rate  of  receipt  of 

behavioral  health  care  (see  Figure  2-1)  for  all  GA  recipients.  Chapter  6  presents  evidence 
on  how  this  occurred  for  DMHAS  services  in  New  Haven  and  Hartford.  There  is  no  way 
to  estimate  change  in  rates  of  access  to  non-DMHAS  services,  or  for  Bridgeport  GA 
recipients.  However,  the  magnitude  of  the  effects  in  both  Hartford  and  New  Haven  do 
suggest  an  overall  increase  in  access. 

This  finding  does  not  quite  capture  the  complexity  of  the  triage  process,  as  not  all 
GA  recipients  need  behavioral  health  services.  For  recipients  with  no  behavioral  health 
needs,  a  45  minute  to  2  hour  screen  is  unnecessary,  or  even  an  unwelcome  intrusion  into 
their  privacy.  Screening  is  also  expensive,  and  must  be  performed  by  staff  that  could  be 
providing  treatment. 
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Clients  with  missing  diagnoses  are  highly  unlikely  to  receive  follow-up  care 
(RR=0.10  for  Hartford,  and  RR=0.096  for  New  Haven),  and  missing  diagnoses  were  only 
recorded  at  GAP  intake  units.  Clients  first  contacting  the  DMHAS  system  from  other 
portals  had  no  missing  diagnoses.  Since  so  many  referrals  to  the  GAP  come  from  GA 
caseworkers  (but  not  all),  we  can  safely  assume  that  missing  diagnoses  most  often 
indicates  a  client  has  no  clinical  need,  and  the  GA  caseworker  referral  was  incorrect.  The 
following  tables  displays  percentage  of  GA  clients  with  no  recorded  diagnosis  that  first 
accessed  DMHAS,  by  entry  portal. 

Table  7-1:  Percentages  of  subjects  with  missing  diagnoses  at  initial  DMHAS  contact, 
by  intake  unit  and  period 


Hartford 

New  Haven 

Period 

GAP 

Other 

GAP  Collocation 

GAP  SA  Clinic 

Other 

Site 

Site 

1 

0% 

0% 

55% 

0% 

18% 

0% 

3 

84% 

0% 

57% 

88% 

0% 

4 

54% 

0% 

9% 

93% 

0% 

5 

88% 

0% 

13% 

93% 

0% 

6 

62% 

0% 

6% 

91% 

0% 

In  all  analyses,  the  GAP  was  assumed  fully  operational  at  the  start  of  period  3,  although  there  was  some 
minimal  GAP  activity  in  Period  2-then  cell  counts  for  Period  2  non-zero  values  are  5  for  Hartford  and  6  for 
New  Haven. 


The  New  Haven  collocation  site  had  lower  values  of  missing  diagnoses  than  the 
Hartford  site  in  each  period.  The  missing  rates  were  highest  at  the  start  of  the  program 
(Period  3— see  note)  and  when  Hartford  relied  less  on  GA  caseworker  referral  (Period  5). 
Though  New  Haven's  substance  abuse  site  may  have  seen  a  population  with  a  higher 
percentage  of  clients  with  substance  abuse  problems  than  the  collocation  site,  it  did  not 
rely  on  GA  caseworker  referrals  at  all.  The  population  differences  would  not  be  great 
enough  to  explain  the  differences  in  missing  rates. 
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These  relative  difference  in  collaboration  between  the  various  GAP  intake  units 
and  GA  Caseworkers  could  explain  these  findings.  The  generic  GAP  model  (Figure  3-2) 
indicates  GA  Caseworkers  are  the  service  providers  who  can  refer  GA  recipients  to  the 
GAP,  and  this  holds  true  for  each  of  the  site  specific  flow  charts  as  well  (Figures  3-3,3- 
4,3-5).  GA  Caseworkers  act  as  important  filters  for  the  GAP,  and  the  quality  of  filtering 
appears  to  depend  on  the  degree  of  collocation  of  a  GAP  intake  unit. 

2)  The  GAP  model  depends  on  collaboration 

To  summarize,  intensity  of  collocation  does  not  affect  the  absolute  number  of 

referrals  by  GA  caseworkers  to  GAP  staff,  but  rather  the  accuracy  of  those  referrals.  It  is 
not  clear  what  the  specific  mechanisms  are.  Does  more  intensive  collocation  allow  for 
more  informal  contact  and  transmittal  of  appropriate  referral  standards?  Were  Hartford 
GA  staff  not  referring  properly  due  to  the  reported  resentment  or  hostility,  or  fear  of 
layoffs,  or  did  these  relationships  prevent  them  from  learning  the  referral  standard  either 
formally  or  informally?  If  so,  could  these  problems  be  overcome  with  even  more  formal 
training?  These  questions  require  further  study20. 

What  is  clear  in  light  of  the  combined  quantitative  and  qualitative  evidence,  is  that 
the  GAPs  are  a  true  partnership  between  LMHAs  and  city  GA  offices,  and  without 
effective  collaboration  with  GA  case  workers,  efficiency  suffers.  Collocation  does 
appear  to  foster  effective  collaboration,  and  the  GAPs  do  appear  to  increase  receipt  of 
behavioral  health  care. 


Further,  these  client  level  measures  are  too  general,  and  the  Periods  too  long,  to  pinpoint  the  time  and 
causes  for  the  various  changes  in  slope  of  model  suggested  in  Figure  5-1,  where  levels  of  tension  and 
collaboration  change  over  time.  This  relationship  would  be  better  explored  in  future  studies  with  data 
collection  instruments  specifically  designed  to  formally  define  and  measure  these  domains. 
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B.  Intra-agency  effects 

Interestingly,  New  Haven's  GAP  intake  units  had  slightly  higher  follow-up  rates 

than  Hartford's  after  adjusting  for  diagnosis  (see  Table  6-15).  Since  adjusted  likelihood 
of  follow-up  seems  a  reasonable  indicator  of  intra-agency  coordination  of  care,  this 
finding  may  appear  to  contradict  conclusions  in  Chapter  5  where  I  discuss  the  intra- 
agency  information  sharing  conflicts  at  the  New  Haven  GAP  site. 

On  further  reflection,  client  level  analyses  may  actually  support  the  notion  that 
stronger  administrative  links  between  the  GAP  and  the  parent  LMHA  encourage  better 
coordination  of  care.  The  information  sharing  difficulties  in  the  New  Haven  GAP  site 
were  between  the  Hill  Health  Center  and  the  New  Haven  LMHA.  In  some  ways,  the 
New  Haven  LMHA  staff  working  on  the  GAP  were  better  integrated  with  their  LMHA 
than  their  Hartford  counterparts,  because  the  New  Haven  GAP  was  not  its  own  division, 
and  most  screens  done  at  both  New  Haven  GAP  intake  units  were  conducted  by  LMHA 
staff.  This  stronger  intra-agency  integration  could  account  for  the  higher  adjusted 
likelihoods  of  follow-up  between  the  two  GAPs. 

1)  Exclusivity  of  interagency  and  intra-agency  coordination 

Interestingly,  adding  the  client  level  evidence  to  the  qualitative  analysis  suggests 

that  the  New  Haven  GAP  can  simultaneously  be  more  integrated  with  both  the  GA 
welfare  office  and  its  parent  LMHA.  The  pattern  in  the  qualitative  evidence  alone 
suggested  some  degree  of  exclusivity.  Sites  that  reported  the  most  problems  with  their 
GA  welfare  office  (Hartford)  also  had  the  fewest  complaints  and  the  most  cross  division 
coverage  from  their  parent  LMHA.  The  opposite  was  true  for  Bridgeport — it  reported  a 
very  pleasant  relationship  with  GA  staff,  and  complained  about  referral  problems  with  its 
parent  LMHA.  New  Haven  fell  in  the  middle,  and  yet  its  referrals  were  significantly  (p< 
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0.05)  more  accurate.  Did  the  New  Haven  GAP  achieve  some  happy  medium?  Or,  did 
New  Haven  GAPs  multidivisional  staff  model  trump  the  Hartford  LMHA's  spirit  of 
interdepartmental  cooperation? 

The  potential  for  optimization  in  between  interagency  links  and  intra-agency  links 
is  appealing,  and  deserves  further  study.  However,  I  have  found  little  evidence  of  its 
existence.  As  discussed  in  Chapter  6,  the  differences  between  New  Haven  and  Hartford 
sites  follow-up  care  likelihoods  are  not  operationally  significant  (RR=1.07,  95%  CI: 
1.03,1.1 1),  and  therefore  not  strong  enough  to  support  the  idea  of  a  tradeoff  in  intensity 
between  intra-agency  and  inter-agency  links. 

2)  Changes  in  the  DMHAS  Target  population 

In  the  literature  review,  I  discussed  the  theoretical  difficulties  in  integrating 

substance  abuse  and  mental  health  treatment  practices.  The  GAP  made  special  efforts  to 

do  this,  and  staff  at  Bridgeport  and  especially  Hartford  voiced  their  difficulties  in 

reconciling  differing  treatment  models.  If  expanding  the  culture  of  these  small  teams 

were  so  difficult,  informally  changing  the  target  population  for  an  entire  LMHA  would 

probably  be  unlikely. 

The  Hartford  and  New  Haven  GAPs  were  not  able  to  demonstrably  affect  their 

LMHA's  target  population  definition.  Though  subjects  with  inactive  GA  benefits  were 

used  as  controls  for  GAP  effects  in  access  analyses,  these  same  control  groups  can  be 

interpreted  in  another  way.  Changes  in  access  among  this  group  also  indicate  the 

receptiveness  of  DMHAS  to  treating  people  with  the  same  clinical  profile  as  GA  clients, 

but  without  GA  insurance. 
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Figure  6-3  and  Figure  6-4  show  a  slight  increase  in  access  rates  for  subjects  with 
inactive  GA  benefits,  but  the  confidence  intervals  all  overlap,  indicating  these  increases 
were  not  significant.  Increasing  GA  clients  access  to  DMHAS  services  did  not  seem  to 
encourage  other  members  of  the  cohort  to  seek  DMHAS  care  while  their  GA  benefits 
were  inactive,  or  it  did  not  encourage  DMHAS  to  treat  them. 

2.  Managed  care  practices 
A.  Findings 

Another  interesting  aspect  of  the  qualitative  findings  were  the  efforts  that  GAP 
staff  made  to  work  with  private  providers  and  the  sympathy  that  GAP  staff  had  for  them. 
I  hypothesized  in  Chapter  5  that  utilization  management  operated  by  state  agencies  to 
manage  care  delivered  by  private  providers  would  be  less  critical  than  the  same  services 
provided  by  a  private  party.  Unfortunately,  there  is  no  quantitative  information  available 
to  explore  this  claim. 

However,  there  is  evidence  about  DMHAS 's  ability  to  manage  the  services  it 
delivers.  Costs  at  both  sites  for  active  GA  clients  generally  went  down,  suggesting 
intensive  services  may  have  been  replaced  with  less  intensive  forms.  The  Tebes  et  al. 
team's  cost  estimates  (Table  4-7)  demonstrate  that  a  highly  intensive  pattern  of  outpatient 
care  can  be  equivalent  in  DMHAS  resource  usage  to  inpatient  care  (e.g.  3  hours  of 
therapy  a  week  for  one  month  is  equivalent  to  4  days  of  inpatient  care).  However, 
DMHAS  budgets  are  not  based  on  productivity — a  unit  working  at  70%  capacity  may 
have  the  same  budget  as  a  unit  at  90%  capacity,  if  their  staffing  patterns  are  the  same.  In 
the  universe  of  DMHAS  care,  real  savings  can  come  from  reducing  care  of  all  types,  or 
substituting  group  therapy  for  outpatient  care. 
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This  evaluation  has  presented  strong  evidence  that  DMHAS  can  limit  its  own 
costs  through  mechanisms  independent  of  the  GAP.  Non-GA  costs  for  the  study  cohort 
significantly  declined  overall,  for  the  Axis  1  group  in  Hartford  (see  Table  6-30),  and  for 
the  Substance  Abuse  and  MIS  A  groups  in  New  Haven  (see  Table  6-31).  This  is  probably 
due  in  part  to  the  steady  decline  in  DMHAS  inpatient  beds,  and  the  implementation  of 
prior  authorization  for  all  DMHAS  inpatient  care  at  the  beginning  of  Period  2.  A  drop 
occurs  most  notably  in  the  Hartford  data  set  between  Period  1  and  2  (see  Figure  4-5  and 
the  unadjusted  Period  effect  in  Table  6-16).  DMHAS  can  lower  its  utilization  rates — it 
appears  to  have  done  so  for  non-GA  costs  and  there  is  no  reason  to  think  that  it  did  not  do 
it  for  the  GAP. 

On  paper,  the  New  Haven  GAP  had  the  strongest  utilization  management  model 
of  the  three  sites,  with  a  centralized  utilization  management  staff  that  could  approve  care 
by  any  provider.  In  practice,  New  Haven's  DMHAS  utilization  profiles  were  not 
generally  different  from  Hartford's.  The  procedural  differences  in  managed  care  across 
sites  seem  to  have  been  dwarfed  by  the  overall  downward  trend  in  DMHAS  direct  costs 
for  the  cohort,  or  they  were  hidden  because  information  about  outside  providers  was 
unavailable.  After  over  four  years  of  operation,  no  one  can  definitively  say  if  the  GAP 
saved  any  money. 

B.  Minority  differences  and  managed  care 

The  GAP  uses  mechanisms  that  can  theoretically  minimize  differences  in  access 
and  utilization  between  ethnic  and  racial  minorities.  The  GAP  minimized  geographic 
barriers  to  care,  and  increased  case  finding  resources.  It  also  standardized  utilization 
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decision  making.  Despite  these  efforts,  no  real  changes  in  minority  differences  were 
found. 

These  weak  results  can  be  explained  in  several  ways.  The  GAPs'  efforts  did  not 
specifically  intend  to  decrease  racial  disparities  in  access  or  utilization.  But,  such  efforts 
may  have  been  unnecessary  in  the  first  place.  Disparities  in  access  were  fairly  mild  at 
baseline,  and  may  not  be  due  to  service  system  characteristics.  Further,  it  is  unreasonable 
to  expect  the  GAP  to  minimize  racial  disparities  in  utilization,  when  it  is  not  clear  if  the 
GAP  was  able  to  affect  utilization  for  the  GA  cohort  as  whole. 

C.  DMHAS  costs  versus  private  costs 

The  actions  the  GAP  sites  took  in  managing  utilization  were  more  complicated 
than  available  data  describe,  as  GAP  clinicians  and  utilization  managers  could  refer 
clients  to  either  their  parent  LMHAs,  or  private  providers  reimbursed  at  Medicaid  rates. 
The  DMHAS  direct  cost  estimates  used  in  this  study  are  derived  only  from  real  costs,  and 
are  more  akin  to  relative  intensity  of  DMHAS  staff  involvement.  Private  provider's  GA 
claims  come  from  Medicaid  rates  that  are  designed  to  be  fractions  of  a  typical  provider's 
total  costs  (which  include  capital  expenditures).  However,  Medicaid  claims  earn 
Disproportionate  Share  payments  from  the  Federal  government,  and  GA  claims  do  not. 

Because  GA  payment  rates  are  so  low,  the  GAP  could  have  saved  money  by  using 
more  third  party  payers  and  less  DMHAS  services.  Public/private  substitution  could 
theoretically  cause  problems  in  the  market  because  of  the  absence  of  disproportionate 
share  payments  to  private  providers,  and  the  waste  of  unused  capacity  in  state  operated 
facilities.  This  dichotomy  in  payment  procedures  may  be  important  enough  to  distort  the 
behavior  of  truly  cost  responsive  managed  behavioral  health  care  for  GA.  As  will  be 
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discussed  below,  this  potential  distortion  may  be  strongest  for  publicly  operated  managed 
care  programs  like  the  GAP. 

However,  this  evaluation  did  not  find  any  evidence  to  suggest  that  the  GAPs 
wished  to  exploit  the  weakness  in  various  payment  systems.  All  discussion  with  GAP 
utilization  review  staff  suggested,  their  primary  motive  was  to  get  GA  clients  appropriate 
care  as  quickly  as  possible. 

3.  The  utility  of  states  directly  administering  managed  care  programs 

Direct  operation  of  managed  care  offers  a  state  mental  health  authority  several 
advantages.  First,  it  offers  direct  control  over  the  entire  managed  care  process  and  avoids 
some  of  the  principal  agent  problems  inherent  in  contracting  with  third  parties.  Second,  it 
offers  greater  protection  to  area  providers  than  a  contractor  may  allow.  Third,  it  offers 
more  funding,  positions,  and  prestige  to  the  agency.  The  appearance  of  managed  care 
savvy  is  especially  important  to  state  mental  health  authorities  as  the  spread  of  Medicaid 
managed  care  threatens  to  shift  control  of  clinical  management  for  many  of  their  clients 
to  state  Medicaid  authority  contracts.  Finally,  it  may  be  cheaper  or  faster  to  avoid  the 
public  contracting  process  for  small-scale  projects  with  only  a  few  hundred  enrollees. 

A.  Problems  with  states  managing  care 

However,  managed  care  is  a  leap  forward  in  complexity  from  the  traditional 

provider  and  network  management  functions  that  state  mental  health  authorities  have 
been  grappling  with.  Hiring  an  insurance  company  to  serve  as  a  managed  care  contractor 
may  allow  a  state  buy  that  expertise,  and  have  the  contractor's  performance  monitored  by 
the  clinical  and  programmatic  experts  in  the  state  mental  health  agency.  But,  as 
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discussed  in  the  literature  review,  this  task  is  difficult,  and  it  would  have  been  DMHAS's 
first  experience  with  managed  care. 

The  GAP  is  even  more  difficult  than  this,  because  it  requires  DMHAS  to  think  as 
an  insurer  (which  it  has  no  experience  doing),  and  leaves  the  Legislature  and  the  Office 
of  Policy  and  Management  to  act  as  an  external  monitor  (a  task  that  they  and  their 
counterparts  in  other  states  do  not  typically  perform  to  the  level  of  detail  that  a  state 
Medicaid  or  behavioral  health  authority  would  when  it  monitors  a  managed  care 
organization).  Why  DSS  did  not  step  into  this  monitoring  role,  especially  after  they  bore 
the  ultimate  risk,  remains  unclear.  Perhaps  the  GAP  was  such  a  small  part  of  their  budget 
and  there  were  so  many  concurrent  changes  with  GA  (such  as  the  state  taking  over  all 
administrative  functions  from  the  towns)  that  the  GAP  received  a  low  priority. 

As  the  following  vignettes  about  the  GAP  development  and  management  process 
will  illustrate,  DMHAS  has  several  deficits  that  hinder  its  ability  to  directly  manage  care. 
First,  it  lacks  a  true  cost  based  accounting  system  and  billing  capacity.  Second,  though 
the  state  captures  eligibility  and  utilization  information,  it  does  so  in  different  places. 
DMHAS  has  not  conducted  any  evaluation  or  monitoring  that  tracks  GA  recipients' 
complete  course  of  benefits  and  treatments  from  the  GAP  through  the  behavioral  health 
service  system,  or  establish  pre  GAP  service  patterns.  This  dissertation  was  the  only 
effort  to  link  welfare  rosters  with  DMHAS  records  from  the  GAP.  Third,  during  the 
study  period,  DMHAS  was  unable  to  get  accurate  risk  adjusted  cost  estimates  or  needs 
assessments  from  the  Department  of  Social  Services,  or  see  the  need  to  generate  its  own. 
Finally,  no  outside  agent  has  been  able  to  convince  the  Department  that  these  deficits 
hinder  its  ability  to  manage  care.  Indeed,  if  the  GAP  has  no  hard  evidence  of  failure,  and 
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mild  evidence  of  success,  and  no  one  complains,  then  DMHAS  has  every  incentive  to 
continue  business  as  usual,  and  not  address  what  ever  problems  or  inefficiencies  may  be 
occurring. 

B.  Planning  process 

Below  I  will  discuss  the  planning  process  for  GAP  implementation  that  occurred, 

as  recorded  in  memoranda  from  March  to  September  1993,  to  illustrate  the  above 
principles.  Though  this  narrative  is  not  meant  to  characterize  the  planning  process  of  the 
entire  GAP  project,  it  does  describe  the  initial  effort  DMHAS  (then  just  the  Department 
of  Mental  Health)  took  to  obtain  accurate  information  in  the  GAPs  earliest  phases. 

DMHAS  staff  worked  with  staff  from  the  Department  of  Social  Services,  City 
welfare  agencies  and  the  Legislature's  Office  of  Fiscal  Analysis  (Connecticut's 
equivalent  of  the  Congressional  Budget  Office)  to  gather  data  for  cost  estimates.  Their 
efforts  were  focused  on  three  areas:  1)  to  estimate  substance  abuse  and  mental  health 
costs  incurred  by  GA  clients  at  each  of  the  three  cities;  2)  to  estimate  the  number  of 
clients  that  received  behavioral  health  services;  and  3)  to  estimate  the  total  number  of 
people  covered  by  GA  medical  benefits.  These  inquiries  were  focused  on  Bridgeport  and 
Hartford  only —  the  New  Haven  site  was  added  well  after  the  planning  process  had 
began. 

Items  one  and  two  were  stored  on  the  claims  and  billing  system  maintained  by  the 
DSS  contractor,  but  as  their  contract  had  just  started  they  were  still  setting  up  their 
systems.  In  late  March  1993,  DMHAS  obtained  some  general  estimates  of  behavioral 
health  expenditures  from  the  City  of  Hartford  and  claimed  they  could  cut  costs  by  25%. 
They  had  no  data  or  made  any  specific  projections  to  support  this  claim. 
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The  Department  pushed  harder  for  a  more  informed  estimate.  Both  DMHAS  and 
the  Hartford  Department  of  Social  Services  obtained  a  report  from  the  DSS  contractor 
dated  5/14/93,  but  it  was  discounted  by  DSS  staff  as  undercounts  of  the  number  of 
utilizers  and  their  claims.  I  have  no  record  of  further  analysis  of  this  report  by  DMHAS 
staff.  However,  the  Hartford  welfare  office  quoted  figures  from  this  report  back  to 
DMHAS  on  7/15/93  to  answer  the  three  questions.  Apparently,  DMHAS  either  did  not 
trust  or  understand  the  May  expense  report  (it  was  a  table  of  costs  and  service  codes,  and 
I  found  it  very  confusing),  but  they  did  include  Hartford's  synthesis  of  it  in  future 
documents. 

Apparently,  all  parties  were  concerned  by  the  lack  and  shortcomings  of  the 
available  information.  July  19,  1993,  the  Secretary  for  the  Office  of  Policy  and 
Management  (the  state  equivalent  of  the  Office  of  Management  and  Budget)  sent  a  letter 
to  the  Commissioners  of  DSS  and  DMHAS.  Its  opening  line:  "As  you  are  aware,  this 
office  has  expressed  some  concerns  regarding  the  financial  assumptions  on  which  this 
initiative  is  based".  It  then  went  on  to  approve  the  GAP  program  anyway,  and  hoped  the 
additional  staff  and  funds  would  "allow  the  department  [DMHAS]  to  more  precisely 
define  the  programmatic  requirements".  On  July  22,  DMHAS  compiled  the  Hartford 
Welfare  office/  DSS  contractor  estimates  with  more  cursory  information  from  Bridgeport 
into  a  report  to  the  Governor's  office.  The  report's  author  wrote  on  the  cover  memo  of  a 
draft  to  his  supervisor  "I  realize  the  document  is  short  on  data — but,  scandalous  as  it  is, 
the  fact  remains  that  these  are  the  best  data  available." 

DMHAS  and  its  sister  agencies  made  a  good  faith  effort  to  find  data  that  would 
support  reasonable  cost  estimates.  They  failed  because  of  time  pressure  and  a  poor 
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information  infrastructure  that  has  not  improved  very  much  since  1993.  However,  they 
made  two  more  serious  flaws  described  below.  Combined,  these  two  mistakes  suggest 
that  the  Department  was  either  not  sufficiently  aware  of  or  concerned  about  financial  risk 
or  population  based  outcomes. 

First,  I  have  no  record  or  knowledge  of  DMHAS  following  up  on  their 
information  needs  after  they  received  funding  approval  from  OPM.  Most  agencies  would 
probably  also  stop  looking  for  information  if  their  initial  arguments  were  effective,  but  it 
left  DMHAS  with  a  poor  foundation  to  understand  any  changes  it  may  have  made  to  care 
for  GA  recipients. 

The  second  error  is  a  conceptual  one:  DMHAS  analyses  considered  only  how  it 
would  manage  utilization  of  GA  clients,  even  though  they  were  purposefully  changing 
the  probability  of  accessing  care  for  the  entire  population.  Every  DMHAS  document  I 
have  read  regarding  the  GAP  and  many  informal  conversations  with  DMHAS  staff  reflect 
this  error.  DMHAS  apparently  did  not  consider  how  the  case  finding  aspects  of 
collocation  may  cause  a  higher  portion  of  GA  recipients  to  seek  behavioral  health 
services  and  ruin  any  cost  estimates,  or  how  the  GA  population  may  change  over  time. 

It  is  possible  that  this  second  error,  at  least  initially,  could  have  been  deliberate. 
DMHAS  may  have  intentionally  underplayed  its  case  finding  role  in  order  to  expand 
services  without  arousing  concerns  from  outside  agencies.  The  head  of  the  Office  of 
Policy  and  Management  may  have  been  aware  of  this  too,  because  he  wrote  in  that  same 
7/19/93  memo:  "While  we  fully  support  the  concept  of  better  coordinated  and  more 
appropriate  mental  health  services  for  this  population,  this  initiative  was  clearly  intended 
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to  be  a  reallocation  of  resources  from  one  State-funded  program  [DSS]  to  another 
[DMHAS]  and  not  a  program  expansion  per  se." 

The  GAP  does  appear  to  be  a  program  expansion,  and  is  especially  risky  for  two 
reasons.  First,  the  underlying  clinical  needs  of  GA  enrollees  had  not  been  estimated,  and 
second,  the  treatment  budget  was  based  on  a  fraction  of  prior  expenditures  that  were 
incurred  before  access  enhancing  mechanisms  were  implemented.  Ignoring  connections 
between  these  two  decisions  can  throw  off  a  cost  projection  and  threaten  the  viability  of 
the  entire  enterprise.  Regardless  of  whether  the  client  or  the  insurer  is  at  fault, 
unintended  utilization  or  high  cost  can  derail  a  program — it  caused  one  insurance  plan  to 
close  in  Minnesota  (Moscovice,  Lurie,  Christianson,  Finch,  Popkin  &  Akhtar,  1993),  and 
high  costs  led  New  York  state  to  terminate  the  Rochester  capitation  experiment  (Hoge, 
Jacobs,  Thakur  &  Griffith,  1998). 

Such  deliberate  behavior  would  not  be  expected  from  the  three  more  traditional 
types  of  managed  care  organizations.  Risk  bearing  private  contractors  are  much  more 
accountable  to  financial  demands.  Even  the  claims  that  ASOs  will  be  motivated  to 
uphold  a  high  standard  of  managed  care  primarily  by  concern  for  their  reputations  (Ma  & 
McGuire,  1998;  Goldman,  McCulloch  &  Sturm,  1998)  do  not  extend  to  increasing  access 
to  care  regardless  of  available  funds.  Non-profit  managed  care  organizations  are  also  not 
hypothesized  to  act  in  this  way  (Schlesinger,  Gray  &  Bradley,  1996). 

DMHAS  may  have  run  this  risk  accidentally,  due  to  its  lack  of  information,  and 
potential  lack  of  skill  or  even  naivete  regarding  managed  care.  However,  the  intentional 
increased  risk  hypothesis  is  also  plausible  ~  as  a  public  agency,  DMHAS  could  have 
been  more  sensitive  to  its  professional  norms  to  expand  access  to  care  than  the  potential 
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political  ramifications  of  an  overdrawn  budget.  It  is  possible  that  managed  care  programs 
administered  by  a  public  agency  may  result  in  a  reversed  role  moral  hazard,  where  the 
managed  care  organization  deliberately  increases  its  risk  by  engaging  and  treating 
enrollees  who  need  services  but  would  not  otherwise  seek  them,  even  if  it  meant 
increasing  financial  risk  for  the  agency. 

C.  Operational  process 

DMHAS  was  rewarded  for  its  poor  planning  in  December  1994  when  DSS 

decided  it  was  too  expensive  and  difficult  to  determine  what  portion  of  GA  medical 
expenditures  were  behavioral  health  related  and  what  belonged  to  DMHAS.  Instead,  they 
decided  that  DMHAS  should  no  longer  be  at  risk  for  any  of  the  expenses  GA  clients  may 
incur,  other  than  the  costs  of  service  provided  by  DMHAS  institutions. 

DMHAS  was  further  encouraged  in  their  thinking  by  weak  legislative  oversight. 
DMHAS  was  compelled  to  create  monthly  reports  for  the  legislature  (I  worked  on  many 
of  them).  These  reports  contained  information  only  on  absolute  counts  of  services. 
There  was  never  any  discussion  of  a  denominator  population — the  total  number  of  people 
eligible  for  services.  There  was  also  no  discussion  of  Pre-GAP  data  to  provide  reference 
for  any  change. 

Beyond  the  legislative  reports,  planning  and  monitoring  of  the  GAP  also  focused 
only  on  those  who  got  care.  I  found  no  evidence  of  formal  consideration  of  changes  in 
probability  of  access  for  the  entire  GA  population,  nor  were  there  any  'per  enrollee' 
denominators  when  reporting  screenings  or  inpatient  hospitalization  diversions.  Though 
performing  these  functions  are  hallmarks  of  good  clinical  management,  they  do  not 
account  for  a  population  wide  perspective  that  is  also  part  of  sound  managed  care. 
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4.  Ways  to  minimize  problems  endemic  to  publicly  operated  managed  care 

As  these  examples  illustrate,  DMHAS  had  difficulty  in  obtaining  key  elements  of 
information  and  conceptualizing  (or  at  least  publicly  articulating)  the  population-wide 
implications  of  its  policies.  Despite  these  problems,  the  GAP  appeared  to  succeed  in 
some  respects,  and  clearly  did  not  suffer  from  any  major  problem.  There  were  few 
reports  of  informal  complaints  by  private  providers,  and  problems  between  departments 
and  agencies  hindered  efficiency  somewhat,  but  not  to  the  extent  that  programs  were 
dysfunctional.  As  far  as  I  know,  the  most  serious  problems  of  manage  care,  financial 
insolvency  or  management  errors  that  lead  to  client  harm,  never  occurred. 

To  synthesize,  the  problems  the  GAP  suffered  from,  poor  information  systems, 
incompatible  public  and  private  billing  practices,  and  an  obligation  to  protect  private 
providers,  are  probably  common  to  all  state  mental  health  authorities.  Potentially  poor 
internal  planning,  and  weak  internal  performance  monitoring  and  external  oversight  may 
also  be  endemic  to  the  GAP  model.  They  stem  from  a  State  Behavioral  Health  Authority 
trying  to  operate  as  an  insurance  program  and  leaving  other  state  agencies  or  the 
Legislature  to  provide  managed  care  oversight — tasks  with  which  neither  the  Connecticut 
players  or  most  of  their  counterparts  in  other  states  have  experience. 

Some  of  these  problems  are  ingrained  and  difficult  to  correct,  while  others  may 
have  simpler  solutions.  Because  direct  management  by  public  agencies  has  "its  own 
inherent  political  appeal,  I  will  avoid  discussion  of  ways  to  sidestep  these  problems,  such 
as  creating  public  corporations  or  contracting  to  a  private  managed  care  organization. 
Below,  I  will  suggest  some  realistic  solutions  that  could  help  state  agencies  directly 
manage  care. 
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The  most  ingrained  problem  DMHAS  faced  is  the  difficulty  with  accounting  and 
information  systems.  This  is  probably  typical  of  all  public  sector  agencies,  and  it  has  no 
easy  solutions.  Over  time,  one  would  hope  that  information  systems  would  become 
more  successful  at  tracking  the  elements  that  are  used  to  define  direct  costs — time  of 
client  staff  contact,  insurance  status  of  clients  over  time,  and  so  forth. 

However,  the  GAP  suffers  from  more  than  poor  information.  It  asks  public  sector 
employees  to  manage  care  across  the  privately  operated,  publicly  funded  system  as  well 
as  the  publicly  operated  system,  and  as  discussed  above,  costs  or  bills  generated  by  these 
two  systems  are  not  comparable  (and  DMHAS  did  not  bill  for  GA  funded  services  at  all). 

If  a  utilization  review  nurse  or  triage  worker  has  the  choice  between  two  inpatient 
providers  of  equal  quality  but  one  is  public  and  the  other  is  private,  which  does  he  or  she 
choose?  A  private,  risk  bearing  entity  has  a  clear  obligation  to  its  payer  to  choose  the 
provider  that  will  generate  the  lowest  bill.  The  decision  is  not  so  clear  when  the  payer 
and  risk  barer  is  a  government,  especially  since  private  prices  are  regulated  below  cost 
and  public  costs  are  effectively  unknown.  Further,  a  government  may  have  an  obligation 
to  ensure  the  strength  of  the  market,  both  to  ensure  an  adequate  supply  of  providers  for 
critical  services,  and  to  protect  a  strong  political  constituency.  Choosing  one  provider 
over  another  may  affect  the  stability  of  this  market.  This  is  especially  true  for  the  GA 
system  that  is  further  distorted  by  the  absence  of  disproportionate  share  payments21. 


21  However,  private  providers  that  typically  see  GA  clients  also  receive  grants  from  DMHAS  to  provide 
services  for  people  with  no  benefits.  The  manager  of  a  regional  DMHAS  substance  abuse  system  has 
complained  to  me  that  sometimes  uninsured  clients  have  difficulty  getting  access  from  some  of  these 
providers  that  receive  DMHAS  grants  while  GA  clients  do  not.  If  this  allegation  is  true  (I  have  no  evidence 
to  confirm  or  deny  it),  then  DMHAS  grants  may  have  replaced,  some,  part,  or  more  of  the  underpayment  in 
GA  rates  in  the  way  that  Disproportionate  Share  does  for  Medicaid. 


251 


The  process  of  defining  and  generating  accurate  costs  is  expensive  and  difficult. 
Since  the  market  has  not  collapsed  without  this  information,  the  expense  of  doing  so  is 
probably  not  justified  considering  the  marginal  improvements  it  may  lead  to.  However, 
publicly  run  managed  care  may  have  to  be  more  sensitive  to  the  needs  of  their  private 
providers  in  their  provider  networks  than  privately  run  managed  care  organizations  for 
economic  reasons,  as  well  as  the  political  one  discussed  in  prior  chapters.  This  degree  of 
'softness'  in  prior  authorization  should  be  accounted  for  when  managed  care  is  run  by  a 
government. 

Complete  availability  of  GA  claims  data  would  have  allowed  for  a  more  accurate 
description  of  the  GAPs  effect  on  substitution,  and  accurate  and  timely  information  may 
have  allowed  DMHAS  to  make  more  educated  planning  decisions  in  the  early  phases  of 
the  GAP.  Developing  information  systems  robust  enough  to  meet  these  needs  is  another 
long  term  and  expensive  goal. 

As  the  analyses  in  the  prior  chapter  demonstrate,  cost  estimates  do  not  have  be 
completely  accurate  to  make  judgements  about  a  program's  effectiveness  in  managing 
utilization.  However,  identifying  baseline  information  about  a  client  pool  before 
accepting  financial  risk  for  their  care  is  so  important  that  is  does  warrant  special  studies 
or  data  collection  to  determine  them.  DMHAS  could  have  conducted  an  electronic 
linkage  study  on  an  entire  cohort  as  I  did,  or  conducted  some  sort  of  needs  assessment 
survey  to  determine  the  need  for  screening  and  treatment  planning,  and  how  the 
introduction  of  those  services  might  change  access  rates. 

The  fact  that  DMHAS  did  not  appear  to  understand  the  GA  population  and  its 
needs  while  developing  the  GAP  also  suggests  some  failure  in  external  oversight/  and  or 
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technical  error  on  the  part  of  DMHAS  staff.  Below  are  some  suggestions  to  minimize 
these  problems  of  expertise  and  accountability.  One  strategy  is  to  increase  the  managed 
care  expertise  available  to  DMHAS  and  its  oversight  agencies.  The  other  is  to  improve 
the  quality  of  oversight  itself.  Again,  the  idea  is  that  though  the  public  sector  information 
infrastructure  has  many  problems,  a  public  agency  can  find  ways  to  work  around  these 
problems  if  they  have  sufficient  expertise  or  motivation. 

A.  Increasing  expertise 

The  apparent  lack  of  information  in  the  planning  process  may  have  been  corrected 

if  the  GAP  was  contracted  to  a  private,  risk  bearing,  entity.  A  private  contractor,  much  in 
the  way  that  Medicaid  managed  care  contractors  work,  could  have  introduced  people 
familiar  with  setting  up  and  running  insurance  programs  into  the  discussion.  Further,  a 
responsible  private  agent  would  have  required  more  detail  or  special  protections  before 
accepting  financial  risk  for  this  population,  and  would  not  have  allowed  the  discussion  of 
unknown  risk  to  drop  before  starting  services  the  way  that  the  Office  of  Policy  and 
Management  apparently  did. 

However,  DMHAS,  like  many  other  state  behavioral  health  authorities,  could 
internally  have  met  the  planning  and  monitoring  standards  needed  to  administer  a 
managed  care  contract  if  it  saw  the  need.  Further,  a  DMHAS  manager  with  insurance 
experience  could  have  helped  implement  these  standards.  This  combination'of  more 
careful  planning  and  relevant  experience  may  have  been  able  to  help  DMHAS  resolve  its 
apparent  information  deficit  in  the  same  way  as  a  contractor  would,  while  maintaining 
direct  DMHAS  control. 
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DMHAS  has  been  making  an  effort  to  hire  personnel  with  experience  in 
administering  managed  care  contracts.  However,  to  my  knowledge,  it  has  not  hired 
senior  staff  with  operational  insurance  experience,  nor  has  it  seen  the  need  for  elaborate 
planning  and  monitoring  of  the  GAP  model. 

A  far  less  expensive  idea  would  be  to  informally  introduce  additional  technical 
skills  into  DMHAS  through  a  steering  committee  comprised  of  experts  from  the  private 
insurance  field,  but  this  idea  would  not  improve  external  oversight.  Steering  committees 
have  been  used  successfully  in  other  states  to  help  state  agencies  think  through  technical 
issues  surrounding  insurance  and  risk  pools  (Swartz  &  Garnick,  1998).  Traditional 
DMHAS  constituents  (consumers,  families,  labor  unions,  providers)  are  just  as  new  to 
managed  care  as  DMHAS,  and  would  probably  not  be  as  helpful  in  addressing  the 
technical  concerns  I  raised. 

B.  Increasing  expertise  and  accountability 

None  of  the  above  ideas  to  increase  internal  expertise  or  monitoring  capacity 

would  increase  DMHAS  accountability  to  other  agents,  such  as  the  Legislature  or  other 
Departments.  Medicaid  managed  care  offers  a  useful  example  of  public  sector  managed 
care  that  increases  both  expertise  and  accountability.  These  programs  have  become  more 
prevalent  as  the  federal  government  has  devolved  money  and  authority  to  states. 
However,  it  is  harder  to  devolve  expertise,  and  managed  care  is  an  extremely  technical 
enterprise. 

To  get  around  this  problem,  the  Health  Care  Finance  Agency  (HCFA)  has  created 
an  elaborate  managed  care  proposal  review  and  evaluation  process  for  Medicaid  managed 
care  waivers.  HCFA's  input,  as  a  neutral,  outside  agency  with  national  experience  in 


254 


insurance,  may  have  helped  DMHAS  and  other  state  actors  in  thinking  through  the  GAP 
design,  deciding  what  level  of  information  was  minimally  adequate  before  starting  the 
GAP,  developing  ways  to  supplement  the  information  over  time,  generating  a  savings 
estimate,  and  conceptualizing  the  impact  of  increasing  access. 

A  sufficiently  experienced  consultant  may  also  have  been  able  to  help  DMHAS 
monitor  its  actives  and  conceptualize  risk.  However,  consultants  tend  to  be  most 
responsive  to  the  concerns  of  their  employer  (Weimer  &  Vining,  1992).  If  DMHAS 
hired  the  consultant,  the  fiscal  concerns  of  the  Office  of  Policy  and  Management  may  not 
have  been  represented.  In  the  interests  of  true  accountability,  a  consultant  could  have 
been  hired  by  OPM  or  the  Legislature  to  review  the  GAP  plan  and  advise  DMHAS  on  its 
development.  This  professional  advice  may  also  have  been  useful  in  helping  the 
Legislature  identify  essential  elements  [like  denominators,  or  many  of  the  performance 
contracting  measures  developed  for  Medicaid  managed  care  (see  Rohland  &  Rohrer, 
1997)]  to  include  on  its  monthly  reports. 

5.  Conclusions 

The  GAP  offers  strong  evidence  that  collocating  behavioral  health  staff  at  welfare 
offices  and  having  welfare  staff  refer  clients  to  behavioral  health  staff  for  screening  can 
increase  access  to  behavioral  health  services.  The  physical  degree  of  collocation  appears 
to  increase  the  amount  of  tension  and  collaboration  between  behavioral  health  and 
welfare  staff.  Though  this  tension  eases  over  time,  the  degree  of  collaboration  is 
important  in  determining  accuracy  of  screening  referrals  by  welfare  caseworkers  to  the 
GAP. 
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The  success  of  the  GAP  in  managing  utilization  is  less  clear.  The  political 
strength  and  economic  fragility  of  private  providers  suggests  a  publicly  run  utilization 
management  system  like  the  GAP  would  be  more  accommodating  of  private  providers' 
needs  than  even  a  private  managed  care  contractor,  but  there  is  no  data  to  test  this 
hypotheses.  Available  data  shows  that  GA  costs  at  DMHAS  went  down  during  the 
course  of  the  GAP,  but  no  faster  than  costs  for  the  same  cohort  at  DMHAS  while  they 
were  not  covered  by  GA  benefits.  It  seems  likely  that  both  sets  of  cost  decreases  were 
due  to  department  wide  utilization  management  and  bed  reduction  programs  implemented 
before  the  GAP. 

Despite  this  weak  evidence,  publicly  run  managed  care  does  offer  some 
advantages  over  alternatives  like  a  private  managed  care  organization  contracted  to  a 
government  agency.  It  offers  the  government  agency  more  prestige,  and  preserves  the 
integrity  of  the  public  providers,  as  well  as  possibly  maintaining  the  integrity  of  the 
private  providers.  However,  state  run  managed  care  also  faces  some  obstacles — a  fiscal 
system  that  makes  it  difficult  to  hold  agencies  at  risk,  weak  external  oversight,  and 
potentially  poor  expertise.  External  review  by  third-party  experts,  such  as  evaluation  and 
technical  assistance  offered  by  HCFA  for  Medicaid  managed  care,  or  technical 
consultants  hired  by  an  outside  agency  such  as  an  Executive  or  Legislative  budget  office, 
may  increase  both  the  accountability  and  expertise  of  publicly  run  managed  care  design 
and  operation.  A  cheaper  and  potentially  less  effective  correction  would  be  for  the  public 
managed  care  agency  to  seek  expert  advice  thorough  direct  hiring,  or  an  advisory  or 
steering  panel  with  membership  from  the  insurance  industry. 
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The  GAP  also  demonstrates  how  the  themes  of  managed  care  and  service 
integration  are  programmatically  related.  Access  to  this  managed  care  program  was 
increased  with  a  traditional  services  integration  mechanism,  collocation.  Centralized 
service  coordination,  a  typical  service  integration  goal,  was  facilitated  by  a  traditional 
managed  care  mechanism,  prior  authorization  utilization  review.  Utilization  management 
also  allowed  DMHAS  clinicians  to  serve  as  gate  keepers  at  the  Bridgeport  site,  probably 
giving  them  unprecedented  control  over  their  client's  non-DMHAS  utilization.  Due  to 
New  Haven's  complicated  arrangements  and  confidentiality  restrictions,  utilization 
management  staff  had  the  best  access  to  information  about  GA  clients'  progress  through 
various  treatment  programs. 

In  more  general  terms,  the  techniques  from  one  system  can  be  used  to  help  the 
other.  Managed  care  does  not  have  to  adopt  cost  control  as  its  primary  goal — its  indirect 
fiscal  incentives  can  be  used  to  further  traditional  service  integration  goals  of  increased 
flexibility  and  coordination  of  care.  Service  integration's  typical  organizational 
interventions,  such  as  inter-agency  collaborations,  or  coordinating  structures  to  manage 
and  develop  treatment  networks,  can  help  further  the  traditional  managed  care  goals  of 
substituting  high  intensity  services  with  low  intensity  services,  or  even  help  in 
negotiating  lower  treatment  rates. 

This  overlap  extends  to  academic  research  as  well.  The  services  integration 
literature  offers  insight  into  implementation  strategies  and  case  study  techniques  that 
could  provide  much  needed  depth  to  managed  care  evaluations.  The  managed  care 
literature  suggests  many  direct  client  level  outcomes  that  can  be  applied  to  service 
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integration  studies.  Acknowledging  this  overlap  between  managed  care  and  service 
integration  will  improve  the  study  and  practice  of  both  fields. 
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Appendix--  Data  handling  and  record  linkage  procedures 

This  appendix  explains  in  detail  the  procedure  used  to  collapse  the  GA  rosters  and 
merge  them  with  DMHAS  utilization  data. 

1 .  The  Hartford  GA  Roster 

The  Hartford  Social  Services  Department  provided  two  extracts  of  General 
Assistance  information,  in  two  waves  of  files.  Their  coding  structure  was  carefully 
checked  with  the  programmer  who  prepared  the  extract  and  Hartford  GA  caseworkers 
who  gathered  the  data  that  the  extract  contained.  The  first  file  set  (n=62,634)  contained  a 
GA  case  number  and  the  date  and  nature  of  each  change  in  GA  eligibility  (which  includes 
suspensions  of  cash  payments,  and  administrative  changes  such  as  caseworker 
reassignments).  A  second  client  extract  contained  background  information  on  each  client 
(n=32,157)  and  included  their  names,  case  numbers,  social  security  numbers,  and  limited 
usable  demographic  information  (sex,  race  and  ethnicity). 

These  two  files  were  merged  by  case  number  for  all  clients  18  years  or  older, 
leaving  57,176  records.  Social  security  numbers  that  were  essentially  missing 
('0000000000'  or  '9999999999')  were  dropped  (n=24),  as  were  2268  observations  of 
duplicate  clients  closed  out  by  the  city  of  Hartford22.  Many  of  these  combined  records 
were  also  deleted  when  observations  were  collapsed  so  that  one  observation  encompassed 
an  entire  GA  medical  eligibility  episode,  from  start  of  benefits  to  end  of  medical 
coverage. 


22  Some  of  these  clients  may  have  been  receiving  multiple  benefits  checks,  as  some  have  alleged  (Spada,  1994; 
Keating,  1995),  but  investigating  the  prevalence  of  potential  fraud  is  outside  of  the  scope  of  this  dissertation. 
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This  process  left  a  total  of  41,152  observations  for  26,334  unduplicated  clients. 
The  mean  number  of  episodes  were  1.57  per  client  (SD=0.927)  and  7  clients  had  the 
maximum  of  8  GA  episodes.  Hartford  assigned  clients  who  were  active  at  the  time  of  the 
last  extract  a  benefits  termination  date  of  12/3 1/99.  These  were  converted  to  the  right 
censor  date  of  8/3 1/96.  The  data  set  contained  all  clients  active  as  of  4/1/92,  so  clients 
starting  without  an  open  date  were  left  censored  at  4/1/92  (a  total  of  1614  days  of  follow- 
up). 

2.  The  New  Haven  GA  Roster 

After  careful  consultation  with  City  of  New  Haven  programmers,  I  received  one 
large  data  set  in  two  waves.  Combined,  this  data  set  included  454,71 7  observations  from 
8/31/92  to  8/31/96,  where  every  individual  New  Haven  GA  payment,  caseworker 
reassignment  and  eligibility  transaction,  including  one  time  emergency  cash  grants  and 
burial  payments,  was  stored  as  a  separate  record.  I  did  not  need  this  level  of  operational 
detail,  but  I  would  have  had  to  have  waited  several  months  for  the  New  Haven 
programmers  to  refine  the  data  set  from  me.  Instead,  I  selected  the  relevant  GA 
eligibility  status  records  from  the  original  extracts  myself,  and  was  left  with  56,406 
records. 

The  only  details  these  records  contained  about  individual  clients  were  name,  date 
of  birth,  Social  Security  Number  and  GA  case  number.  Though  these  files  contained  less 
information  than  the  Hartford  data  sets,  the  records  I  was  interested  in  were  much 
cleaner,  and  I  did  not  encounter  the  problems  with  Social  Security  numbers  that  I  did 
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with  Hartford.  The  meaning  of  the  various  open  and  close  codes  were  confirmed  through 
discussion  with  New  Haven  programmers  and  GA  caseworkers. 

The  56,406  eligibility  status  change  transactions  were  collapsed  into  32,802 
discreet  periods  of  GA  medical  eligibility.  Clients  with  transactions  records  indicating 
that  their  medical  benefits  ended,  but  with  no  start  of  medical  coverage  record  were  left 
censored  at  8/3 1/92.  Clients  with  a  start  of  coverage  record,  but  no  end  of  coverage 
record  were  right  censored  at  8/3 1/96  (1462  total  days  of  follow-up).  This  collapsing  and 
censoring  procedure  yielded  18,412  unduplicated  clients  with  a  mean  of  1.73  eligibility 
episodes  each  (sd=1.10).  Seven  clients  had  the  maximum  of  9  episodes  during  follow- 
up. 

3.  DMHAS  Utilization  Records 

As  mentioned  before,  this  analysis  only  included  records  from  DMHAS 's  online 
clinical  information  system  used  by  DMHAS  facilities  for  reporting  and  patient 
management.  In  total,  this  database  includes  information  on  roughly  50,000  unduplicated 
clients  across  over  a  dozen  different  subsets  of  data,  all  connected  together  by  DMHAS 's 
unique  client  identifier.  This  data  system  is  complex,  and  many  fields  have  changed  over 
time.  Despite  my  years  of  experience  with  these  data  systems,  I  had  to  carefully  question 
programmers  at  Central  Office,  and  quality  assurance  staff  and  line  staff  at  the  various 
GAP  sites  about  how  specific  fields  are  collected,  entered,  and  used  by  clinical  staff. 
There  are  four  subsets  of  data  that  I  drew  from. 

The  first  DMHAS  data  set  records  all  screenings  performed  by  GAP  units.  It 
contains  the  client's  name,  date  of  birth,  social  security  number,  DMHAS 's  unique  client 
identifier,  provisional  diagnosis,  race,  ethnicity,  marital  status,  language,  and  educational 
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level.  The  New  Haven  GAP  relies  on  five  triage  gates,  and  only  two  of  these  gates  are 
staffed  by  DMAHS  employees.  The  other  assessments  are  not  stored  in  this  data  set. 
From  July  1,1995  to  June  30,  1995,  the  DMHAS  triage  gates  accounted  for  72%  of  all 
New  Haven  GAP  screenings.  Therefore,  DMHAS  screenings  are  not  the  ideal  indicator 
of  the  New  Haven  GAP's  productivity — rather  they  are  an  unbiased  indicator  of  the 
additional  access  to  DMHAS  facilities  that  the  GAP  afforded.  The  Hartford  GAP  has  no 
triage  gates,  and  all  of  its  assessments  are  stored  in  this  database.  Since  these  records  are 
stored  by  screening  unit,  I  isolated  all  the  screening  records  for  the  New  Haven  and 
Hartford  GAPs  that  occurred  before  9/1/96. 

For  the  other  DMHAS  data  sets,  I  was  not  able  to  pull  out  GA  Recipients  based 
on  any  information  collected  by  DMHAS.  Instead,  I  linked  the  DMHAS  demographic 
database,  treatment  assignment  database,  and  service  logs  with  the  city  GA  Rosters. 
After  a  brief  description  of  these  three  data  sets,  I  will  describe  the  record  linkage 
process. 

The  second  DMHAS  data  set  is  an  unduplicated  demographic  database  that 
contains  information  such  as  name,  social  security  number,  race,  sex,  marital  status,  date 
of  birth,  and  primary  language.  This  information  is  supposed  to  be  collected  and  updated 
every  time  a  client  starts  a  new  episode  of  treatment  at  a  DMHAS  facility,  but  the 
missing  data  rate  can  be  as  high  as  50%  for  some  variables  (such  as  Veteran-status).  In  a 
previous  study  looking  at  readmission  rates  through  these  databases,  my  colleagues  and  I 
found  that  higher  rates  of  missing  demographic  data  were  negatively  associated  with 
multiple  episodes  of  care  (Thakur,  Hoff,  Druss  &  Catalanotto,  1998). 
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The  third  data  set  contains  dates  and  diagnoses  for  all  DMHAS  treatment 
assignments,  linked  to  the  demographic  file  by  DMHAS's  unique  client  identifier.  In  the 
case  of  inpatient  hospitalization,  each  day  of  the  care  assignment  corresponds  to  one  dav 
of  inpatient  treatment.  In  the  case  of  ambulatory  services  (including  day  hospital 
services),  that  is  not  necessarily  true —  clients  do  not  always  receive  treatment  every  day 
during  an  episode. 

The  final  DMHAS  data  set  is  most  important  in  tallying  treatment  costs  for 
DMHAS  services,  and  contains  a  specific  date,  time,  and  duration  (in  minutes)  for  every 
ambulatory  service  provided  to  a  client.  Each  record  is  one  treatment  session,  and  these 
multiple  sessions  are  linked  to  a  specific  treatment  assignment  by  assignment  a  number 
common  to  both  this  service  log  and  the  assignment  database.  Unfortunately,  after  my 
access  to  DMHAS  data  had  been  terminated,  I  discovered  that  I  somehow  failed  to  obtain 
service  log  records  on  duration  of  individual  treatment  sessions  after  June  30,  1996. 
Therefore,  for  the  costs  analyses,  follow-up  will  end  2  months  earlier. 

These  service  log  records  are  stored  when  clinicians  fill  out  contact  sheets 
reporting  their  activities  with  clients.  Discussions  with  facility  information  management 
staff,  clinical  supervisors,  as  well  as  academics  conducting  cost  studies  at  DMHAS 
facilities  (Sledge,  Tebes,  Wolff  &  Helminiak,  1996;  Tebes,  Wolff  &  Helminiak,  1998) 
suggest  that  clinicians  have  always  resented  filling  out  these  forms.  However,  these 
contact  sheets  are  the  clinician's  only  true  measure  of  productivity,  and  managers  have 
been  placing  increasing  importance  on  them  over  time,  probably  creating  a  bias  towards 
less  under-reporting  at  the  end  of  this  study's  follow-up  then  at  the  beginning. 
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4.  Merging  DMHAS  and  GA  records 

To  assess  how  the  GAP  may  have  changed  access  to  DMHAS  services,  or  costs 
of  DMHAS  services,  the  rosters  were  linked  with  DMHAS  utilization  records.  This 
would  allow  comparisons  of  clients  before  and  after  implementation,  and  due  to  the 
episodic  nature  of  GA  medical  coverage,  also  compare  people  while  they  are  off  and  on 
General  Assistance. 

The  GA  Rosters  and  the  DMHAS  files  shared  the  following  common  identifying 
information:  Name,  Social  Security  Number,  Date  of  Birth.  Of  all  of  these  fields,  only 
Social  Security  Number  is  supposed  to  be  unique  for  each  individual.  It  is  possible  for 
misspellings,  transpositions,  and  other  information  collection  or  data  entry  problems  to 
occur  in  either  data  set,  leaving  no  standard  to  judge  the  accuracy  of  either  database. 
Further,  some  records  in  both  the  Rosters  and  the  DMHAS  data  sets  were  missing  dates 
of  birth,  and  some  records  in  the  DMHAS  data  sets  were  missing  Social  Security 
Numbers. 

However,  since  all  clients  in  the  DMHAS  screening  data  base  are  supposed  to  be 
active  GA  enrollees,  I  would  expect  all  clients  in  that  database  to  match  with  clients  in 
the  GA  rosters.  Matching  these  two  sets  of  databases  allowed  me  to  test  the  merit  of  the 
matching  technique. 

I  employed  a  cascading  linkage  procedure  for  each  group  of  GAP  site  data  sets, 
starting  with  the  most  specific  match  criteria,  and  then  employing  ever  looser  matching 
restrictions  on  the  remaining  unlinked  records.  Records  were  only  linked  when  they 
matched  on  at  least  two  identifiers.  More  specifically,  here  are  the  steps: 
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First,  GA  Roster  and  GAP  screening  files  were  matched  by  identical  Social 
Security  Numbers.  Combined  records  that  also  had  identical  Dates  of  Birth  or  Names 
were  assumed  positive  matches. 

Second,  the  remaining  records  for  the  Screening  data  set  that  could  not  be 
matched  were  linked  to  all  remaining  GA  Roster  records  by  matches  on  the  Soundex 
value  (SAS,  1990)  of  the  first  names  and  the  Soundex  value  of  last  names2j.  Any 
combination  of  two  exact  matches  between  Social  Security  Number,  Date  of  Birth,  and 
Names  (full  spelling,  not  Soundex  code)  were  assumed  positive  matches. 

Third,  the  remaining  unmatched  records  for  the  Screening  data  set  were  matched 
to  all  remaining  GA  Roster  records  by  Date  of  Birth.  Any  combination  of  two  exact 
matches  between  Social  Security  Number,  Date  of  Birth,  and  Names  were  assumed 
positive  matches. 

Fourth,  the  remaining  records  from  this  match  were  merged  again,  but  this  time 
only  by  Soundex  matches  of  the  first  name  (to  account  for  the  possibility  of  women 
changing  their  last  names  when  the  married).  Any  combination  of  two  exact  matches 
between  Social  Security  Number,  Date  of  Birth,  and  Names  were  assumed  positive 
matches. 

From  the  above  four  steps,  I  removed  records  that  matched  on  Social  Security 
only,  or  on  Date  of  Birth  and  first  two  letters  of  the  first  name.  These  fuzzy  matches 
were  checked  by  hand.  Again,  the  standard  for  linkage  were  matches  on  any  two  of  the 
three  criteria.  However,  if  two  records  appeared  to  match  save  for  some  seemingly 

23  A  Soundex  procedure  is  a  very  old  technique  that  assigns  words  with  similar  sounds  identical  numerical 
scores.  Under  this  system,  Maryanne,  Maryann  and  Marion  would  be  equal,  and  thereby  minimizing  the 
risk  of  losing  potential  matches  due  to  spelling  errors  or  alternative  spellings  of  the  same  person's  name. 
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obvious  data  entry  error,  the  records  were  also  linked.  Common  acceptable  errors 
included:  transposition  of  birth  month,  day  or  year  with  one  another,  or  identical  dates 
with  different  years  (e.g.  04/01/51  and  01/04/51  or  04/01/52);  or  name  misspellings, 
first  and  last  name  transpositions,  or  suffixes  (e.g.  Neil  Thakur  with  Neil  Thaker  or  Neil 
Thakru  or  Thakur  Neil  or  Neil  Thakur,  Jr.).  I  was  more  lenient  if  it  appeared  a  last  name 
changed  due  to  marriage  (e.g.  Jane  Doe,  04/01/17,  222-23-4444  and  Jane  Doe-Smith, 
04/01/71,  222-23-4444)  or  first  name  changed  due  to  a  nickname  (e.g.  Rich  Montoblan, 
3/18/64,  061-77-9990  and  Ricardo  Montoblan,  3/18/64,  SSN  missing.) 
The  results  of  this  matching  process  are  shown  in  Table  A-l. 
Table  A-l:  GAP  Assessment  records  linked  with  GA  Rosters 


Merqe  Criteria 

Hartford 

New  Haven 

Frequency 

Percent 

Frequency 

Percent 

1)  SSN, DOB, Name 

1766 

71.8% 

1058 

44.5% 

2)  SSN.Name 

183 

7.4% 

856 

36.0% 

3)  SSN.DOB 

336 

13.7% 

199 

8.4% 

4)  DOB, Name 

129 

5.2% 

98 

4.1% 

5)  Fuzzy  Matches 

45 

1.8% 

167 

7.0% 

Total 

2459 

100.0% 

2378 

100.0% 

If  records  from  both  the  Assessments  files  and  the  Rosters  were  complete,  or  the 
linkage  process  were  perfect,  I  would  expect  to  find  a  GA  Roster  record  for  every  client 
with  a  recorded  GAP  screening.  Out  of  a  total  of  2,799  people  with  Hartford  GAP 
screenings,  I  was  able  to  link  them  with  2,459  Hartford  GA  Roster  records  (87.9%).  Out 
of  a  total  of  2,688  people  with  New  Haven  GAP  screenings,  I  was  able  to  link  them  with 
2,378  New  Haven  GA  Roster  records  (88.5%).  Forcing  a  greater  percentage  of  matches 
would  have  lead  to  false  positive  matches.  The  magnitude  and  consistency  in  percentage 
of  records  linked  suggests  that  this  process  is  not  creating  any  differential  bias  across 
sites. 
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The  identical  linkage  process  was  used  for  matching  DMHAS  demographic 
records  (the  DMHAS  unduplicated  client  list)  with  the  GA  Rosters,  with  one  exception. 
In  this  case,  the  GA  Rosters  were  the  smaller  set  of  files,  and  these  were  used  as  the 
reference  set  of  records  for  linkage  in  the  same  way  that  the  Assessments  file  served  as 
the  reference  in  the  Roster-Assessment  linkage.  There  is  no  way  to  estimate  how  many 
records  truly  match.  However,  as  the  DMHAS  demographic  database  has  only  one 
record  per  client  that  is  continually  updated,  and  the  Assessment  database  is  essentially  a 
transaction  data  set,  I  would  expect  the  accuracy  of  the  Roster-Demographic  linkage 
process  to  be  somewhat  higher.  The  matching  results  are  presented  in  Table  A-2. 

Table  A-2:  DMHAS  Demographic  records  linked  with  GA  Rosters 


Merqe  Criteria 

Hartford 

New  Haven 

Frequency 

Percent 

Frequency 

Percent 

1)  SSN.DOB.Name 

2019 

71.2% 

2470 

53.0% 

2)  SSN.Name 

180 

6.3% 

1043 

22.4% 

3)  SSN.DOB 

373 

13.2% 

572 

12.3% 

4)  DOB, Name 

192 

6.8% 

332 

7.1% 

5)  Fuzzy  Matches 

71 

2.5% 

245 

5.3% 

Total 

2835 

100.0% 

4662 

100.0% 
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Blasinsky,  Leginski,  Parker  &  Goldman,  1997).  The  GAP  is  part  of  this  trend  to 
coordinate  services  and  systems  in  a  practical,  as  well  as  theoretical,  sense. 

3)  Evidence  for  service  integration 

Despite  theoretical  claims,  it  is  very  difficult  to  attribute  clients'  symptom  change 

to  organizational  change.  In  the  Robert  Wood  Johnson  Program  on  Chronic  Mental 
Illness,  the  most  clinically  relevant  outcome  achieved  by  LMHAs  was  that  clients  were 
assigned  to  case  managers  faster  and  stayed  with  the  same  case  manager  longer  (Lehman, 
Postrado,  Roth,  McNary,  &  Goldman,  1994). 

As  highlighted  in  Outcasts  on  Mainstreet  (1992),  integrating  services  has  shown 
some  success  in  addressing  housing  problems  among  people  with  serious  mental  illness. 
Interim  findings  from  the  McKinney  Homeless  demonstration  programs  indicate  that 
between  74-93  percent  of  homeless  clients  with  psychiatric  disabilities  who  agreed  to 
start  treatment  can  remain  in  stable  community  based  housing  if  they  receive  adequate 
clinical,  rehabilitative,  social,  and  financial  support  (CMHS,  1994).  Allowing  LMHAs  to 
distribute  Section  8  housing  subsidies  helped  some  clients  with  serious  mental  illness  to 
remain  housed  in  the  community  (Newman,  Rechovsky,  Kaneda  &  Hendrick,  1994). 

Service  integration  may  also  affect  perceptions  of  quality.  One  evaluation  of 
county  mental  health  systems  found  staff  from  highly  integrated  counties  ranked  their 
services  as  higher  quality  than  staff  from  less  integrated  counties  (Grusky,  1-996). 
Certainly  the  energy,  funding,  and  attention  required  by  new  service  integration 
initiatives  indicates  to  clinicians  that  they  are  taking  part  in  something  unusual. 
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4)  Limits  of  service  integration 

However,  this  evidence  is  modest.  Though  some  providers  are  convinced  that 

service  integration  can  increase  quality,  service  integration  evaluations  have  only 
indicated  improvements  in  some  process  indicators  and  enhanced  community  living 
among  people  who  have  the  broadest  range  of  service  needs,  those  who  are  homeless  and 
seriously  mental  ill. 

Service  integration  has  limits.  The  needs  of  indigent  people  with  behavioral 
health  problems  are  so  wide  ranging  that  it  is  difficult  to  create  any  supercoordinating 
structure,  such  as  an  LMHA  or  an  HMO,  with  enough  bargaining  power  to  ensure  smooth 
coordination  among  all  the  necessary  providers  (Grusky.  Tierney,  Holstein,  Anspach, 
Davis,  Unruh,  Webster,  Vandewater  &  Allen,  1985).  As  Greenley  points  out  (1992)  "an 
innovative  system  structure  is  only  facilitative"  to  good  patient  care,  and  it  may  be 
unreasonable  to  expect  clinical  gains  by  improving  a  service  system  beyond  some 
baseline  level  of  adequacy.  By  this  logic,  improved  clinical  outcomes  could  be  attributed 
to  a  remedial  correction  of  some  system  dysfunction  rather  than  synergy  between  clinical 
technology  and  service  delivery.  As  Weiss  (1981)  argues,  "changes  in 
interorganizational  systems  are  costly  in  time,  effort  and  morale",  and  given  limited 
potential  gain  of  these  changes,  they  should  not  be  undertaken  lightly. 

B.  What  is  needed  for  integration 

Integration  is  a  well  established  human  service  improvement  mechanism,  and 

there  is  some  consensus  among  organizational  theorists  on  how  to  achieve  it.  Aldrich 
(1976)  claimed  that  the  more  intense  the  inter-organizational  relation,  the  more  likely  that 
an  agency  head  will  desire  increased  standardization.  Over  time,  this  view  has  evolved 
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into  the  widespread  belief  that  several  factors  are  almost  always  necessary  for  successful 
coordination. 

Mandates  like  those  placed  on  local  LMHAs  and  Welfare  departments  by  the 
State  Legislature  to  create  the  GAP  are  useful  in  developing  successful  collaborations 
(Grusky,  Tierney,  Holstein,  Anspach,  Davis,  Unruh,  Webster,  Vandewater  &  Allen, 
1985).  However,  as  Gray  points  out  (1985),  mandates  alone  do  not  guarantee  effective 
collaboration,  but  rather  help  stakeholder  agencies  establish  baseline  power  differentials 
among  themselves — this  informal  hierarchy  smoothes  the  way  for  future  agreements.  In 
this  way,  mandates  can  simplify  negotiations  to  develop  formal  collaborative 
agreements,  which  are  considered  necessary  for  any  extensive  collaboration  (McRae, 
Lawlor,  &  Nelson,  1984).  More  concrete  linkages,  such  as  resource  dependence,  client 
referrals,  or  financial  relationships,  are  also  necessary  (Morrissey,  Tausig,  &  Lindsey, 
1985;  Van  de  Ven  &  Walker,  1984). 

While  these  formal  arrangements  may  be  important,  informal  factors  like 
personal  relationships  also  play  a  key  role  in  developing  and  maintaining  collaborative 
agreements.  Wimpfheimer  (1990)  notes  that  every  agency  in  the  negotiation  process 
must  view  themselves  as  a  "winner",  in  that  each  agency  must  gain  (or  at  least  hold  onto) 
something  out  of  the  collaboration.  Personality  and  "collegial  relationships"  (Clayton. 
1992)  between  agency  leaders  involved  in  developing  the  collaboration  are  also 
important,  because  as  Beatrice  (1990)  points  out,  personal  relationships  can  help 
overcome  organizational  inertia  that  may  spring  up  when  a  collaboration  is  based  solely 
on  organizational  self  interests.  Aldrich  and  Herker  (1977)  place  an  even  greater  role  on 
individuals,  in  claiming  that  it  is  the  ability  of  boundary  spanners  that  makes  the 
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difference  in  negotiating  and  maintaining  successful  collaborations.  Most  compelling, 
Grusky  (1996)  found  that  "the  longer  key  interorganizational  network  agency  directors 
have  served  the  more  likely  the  care  system  was  perceived  as  effective",  because,  he 
claimed,  they  had  more  time  to  establish  formal  and  informal  relationships  with  other 
agency  leaders. 

Though  senior  staff  have  tremendous  impact  on  interagency  relationships,  line 
staff  are  the  ones  who  bear  the  brunt  of  system  wide  changes  and  must  implement  them. 
Maupin  (1993)  points  out  that  collaborations  will  not  conform  to  leadership  expectations 
unless  input  from  line  staff  is  incorporated  into  the  functional  aspects  of  the 
collaboration.  Such  a  failure  could  occur  because  the  planning  process  does  not  reflect 
operational  reality,  or  as  Weiss  points  out  (1981),  line  staff  may  not  have  had  the 
opportunity  to  buy  into  the  plan,  and  may  resist  its  implementation.  For  this  reason, 
Hoge  and  Howenstine  (1997)  recommend  a  participatory  management  style  and  an  open 
planning  processes  when  developing  system  wide  reforms. 

Finally,  because  they  occur  in  dynamic  environments,  collaborative  agreements 
demand  continual  fine  tuning  to  ensure  their  utility  (Gray,  1985)  and  their  congruence 
with  the  original  program  model  and  goals  (Essock  &  Kontos,  1995;  Hadley,  Culhane, 
Mazade  &  Manderscheid,  1994).  Of  course,  while  such  dynamism  may  help  the 
program,  it  complicates  evaluation. 

C.  Implications  for  the  GAP 

This  body  of  literature  has  several  implications  for  the  GAP  designers.  First, 

personal  relationships  among  agency  staff,  and  especially  among  agency  executives,  play 
a  key  role  in  the  success  of  any  interorganizational  collaboration.  Second,  increased 
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interaction  between  different  agency  staff  may  result  in  some  staff  feeling  threatened  by 
others.  Third,  relations  between  agencies  can  be  smoothed  out  through  mechanisms  like 
joint  management  and  joint  training.  Finally,  organizational  structures  designed  to 
coordinate  client  level  services  across  agencies  may  also  have  limited  effects  on  the 
clinical  process,  in  terms  of  number  of  clients  seeking  treatment  or  staying  engaged  in 
treatment. 

However,  these  organizational  and  clinical  impacts  are  secondary  goals:  the  GAP 
was  primarily  designed  to  serve  as  a  managed  care  device  that  would  control  cost  while 
ensuring  quality  behavioral  health  services.  In  fact,  managed  care  and  systems 
integration  are  closely  related  concepts  in  the  public  sector,  and  the  GAP  uses  both  to 
achieve  its  goals. 

4.  Managing  Care 

Managed  care,  or  purposeful  constraints  or  incentives  imposed  by  a  payer  on 
provider  and  client  decision  making,  is  popular  in  public  sector  behavioral  health  because 
it  has  the  potential  to  simultaneously  improve  quality  of  services  and  cut  costs.  This 
section  will  focus  on  theoretical  aspects  of  the  GAP's  managed  care  features — which  are 
broker  model  style  case  management,  utilization  management,  and  global  budgeting. 

A.  Managed  care  principles  in  the  GAP 

Some  scholars  refer  to  broker  model  case  management,  like  the  style  used  in  the 

GAP,  as  specific  and  distinct  element  of  managed  care  (such  as  Gray,  1991;  Mechanic, 
Schlesinger  &  McAlpine,  1995).  However,  this  is  such  a  common  program  in  behavioral 
health  care  that  it  tends  to  be  the  norm,  rather  than  the  exception.  Further,  case 
management  is  usually  not  implemented  to  contain  costs  as  utilization  management  and 
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Kakuma,  1995),  but  people  who  do  not  fit  a  stigmatized  target  population  (e.g.  non- 
disabled  GA  recipients  with  behavioral  health  needs)  are  also  suspected  to  avoid 
providers  and  agencies  that  primarily  serve  stigmatized  groups.  Kline  and  Harris  (1991) 
claim  linkage  models,  like  the  GAP's  collocating  LMHA  assessment  staff  at  Welfare 
offices,  reduces  clients'  stigma  for  treatment  services  because  a  client's  first  contact  point 
with  clinicians  is  outside  of  the  direct  treatment  setting.  Reducing  stigma  should  increase 
client  likelihood  to  access  such  services. 

However,  professional  conflict  is  also  predictable  with  cross  discipline 
collaborations,  and  even  more  so  with  collocation,  because  they  ensure  frequent  and 
unstructured  contact  between  line  staff  from  both  agencies.  Weiss  (1981)  warns  "calls 
for  ...  closer  cooperation  among  groups  of  different  professionals  directly  threaten  the 
structure  of  specialization  and  indirectly  threaten  professional  expertise  within  each  area 
of  specialization".  To  minimize  this  conflict,  Clayton  (1992)  argues  joint  training  can  be 
used  to  "lay  the  ground  work  for  a  good  working  relationship"  and  can  "enhance  mutual 
understanding  and  familiarity".  On  the  agency  level,  Hoge  and  Howenstein7  (1997)  note 
the  importance  of  interagency  committees,  like  the  ones  used  by  all  GAP  sites,  to  help 
manage  potential  conflicts. 

The  logic  of  service  and  systems  integration  has  thoroughly  infiltrated 
Connecticut  behavioral  health  services.  For  example,  Connecticut  has  implemented 
LMHAs,  and  Bridgeport  and  New  Haven  are  2  of  18  nationwide  ACCESS 
demonstration  sites  examining  the  use  of  systems  integration  to  improve  service  delivery 
to  people  who  are  homeless  and  suffer  from  a  serious  mental  illness  (see  Randolph, 

7  One  of  the  authors  had  a  senior  management  position  at  the  New  Haven  LMHA,  and  of  all  the  sites 
studied,  the  New  Haven  GAP  relies  most  heavily  on  joint  management. 
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For  example,  DMHAS  operated  facilities  (like  the  GAP  parent  LMHAs  or  state 
psychiatric  hospitals)  do  not  bill  GA  for  services.  The  LMHA  based  GAPs  have  an 
incentive  to  pass  on  all  care  to  state  hospitals  and  thereby  reduce  cost  of  services  for 
General  Assistance.  The  state  mental  health  authority  can  only  prevent  this  from 
occurring  by  monitoring  services  provided  to  GAP  clients. 

Capitation  may  have  organizational  advantages  for  the  public  sector  as  well. 
Lehman  (1987)  claims  that  fiscal  incentives  on  non-profits  actually  encourage  program 
innovation,  since  non-profits  and  their  staff  can  only  enjoy  fiscal  incentives  indirectly  by 
adding  on  new  staff  or  services.  For  example,  Miller  and  Rago  (1988)  describe  how 
Texas  capitalized  on  the  professional  ethic  and  local  autonomy  of  its  LMHAs  to  change 
their  behavior  with  artificially  low  financial  incentives.  Local  authorities  were  paid 
$35.50  for  every  bed  day  of  inpatient  state  hospital  utilization  they  prevented.  This 
amount  did  not  always  cover  the  full  cost  of  alternative  care,  and  the  local  authorities 
changed  their  practice  style  at  their  own  expense.  Cole  and  associates  (1994)  did  find 
capitated  providers  developing  community  based  alternatives  to  inpatient  care,  such  as 
partial  hospitalization,  in  the  Monroe-Livingston  Capitation  experiment. 

But  this  sort  of  response  was  not  as  strong  as  Lehman  predicted.  In  an  evaluation 
of  the  Rhode  Island  Medicaid  program,  Christianson  and  Linehan  (1989)  found  that  their 
capitated  CMHCs  did  not  develop  new  resources,  though  they  did  appear  to-modify  their 
practice  style  in  response  to  capitation. 

Evidence  specific  to  capitation's  successes  are  mixed.  The  only  generalization 
that  can  be  made  is  that  capitation  is  usually  cheaper  than  behavioral  health  services 
funded  on  a  fee-for-service  basis  (Schlesinger,  1989). 
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b)  Specialized  financial  arrangements 

The  managed  care  industry  has  rapidly  created  many  alternatives  to  traditional 

capitation  models  to  address  some  of  the  flaws  in  managed  care  services.  Many  scholars 

advocate  contracting  all  behavioral  health  services  to  one  managed  care  contractor,  for 

two  reasons.  First,  it  will  protect  the  integrity  of  behavioral  health  benefits,  and  ensure 

they  are  administered  by  experts.  Second,  having  only  one  insurer  eliminates  the 

possibility  of  high  risk  clients  becoming  unevenly  (and  unfairly)  distributed  among 

competing  plans  (Goldman,  McCulloch  &  Sturm,  1998;  Ma  &  McGuire,  1998). 

To  minimize  the  capitation's  incentive  to  under  treat  clients,  Frank,  McGuire  and 
Newhouse  (1995)  recommend  sharing  financial  risk  between  the  purchaser  and  the 
managed  care  organizations.  This  idea  has  been  extended  to  Administrative  Service 
Organizations  (commonly  referred  to  by  their  acronym  ASO),  which  receive  a  fixed  or 
per  enrollee  administrative  fee  to  perform  all  managed  care  functions  (bill  reconciliation, 
utilization  management,  etc),  but  bear  little  or  no  financial  risk  for  treatment. 

Though  there  are  very  few  studies  exploring  the  validity  of  this  financial 
arrangement,  some  scholars  suggest  that  financial  incentives  are  not  always  necessary  to 
motivate  ASOs.  Professional  reputations  of  managed  care  firms  alone  may  be  sufficient 
to  encourage  quality  work  from  a  managed  care  firm,  as  it  could  enhance  their  bargaining 
power  with  their  current  purchaser  in  future  contracts,  or  help  them  gain  new  contracts 
with  other  payers  (Goldman,  McCulloch  &  Sturm,  1998;  Ma  &  McGuire,  1998). 

The  GAP  is  another  variation  on  the  capitation  model,  similar  to  the  ASOs 
discussed  above.  It  is  a  behavioral  health  carveout  in  which  a  government  agency 
administers  managed  care  services  directly,  and  can  refer  clients  either  to  its  own 
facilities,  or  to  private  providers. 
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But  the  GAP's  financial  incentives  are  less  clear  than  an  ASO.  DMHAS  receives 
a  prepayment  to  provide  treatment  and  managed  care  services  to  the  entire  GA 
population.  Initially,  DMHAS  was  completely  at  risk  for  all  GA  behavioral  health 
claims,  though  the  arrangement  was  dropped  a  year  after  implementation.  DMHAS  has 
only  paid  for  the  services  it  provided  through  its  own  facilities — but  DMHAS  never 
billed  GA  for  these  services,  or  been  asked  to  pay  for  the  GA  behavioral  health  services 
offered  by  private  providers. 

Managing  care  through  state  operated  facilities  is  unusual,  and  the  GAPs 
effectiveness  may  be  diluted  in  two  ways  from  the  more  traditional  managed  care  model 
its  planners  apparently  wished  to  emulate.  First,  Connecticut  may  lack  the  information 
infrastructure  to  fully  implement  sophisticated  managed  care  mechanisms.  Second, 
personnel  rules  and  other  bureaucratic  structures  may  prevent  clinicians  and  agencies 
from  being  as  flexible  as  their  privatized  counterparts. 

Properly  understanding  service  costs  is  important  for  managed  care  (Cuffel, 
Snowden,  Masland,  &  Piccagli,  1996),  both  to  set  prepaid  rates  (Frank  &  McGuire,  1994; 
Frank,  McGuire,  &  Newhouse,  1995)  and  to  negotiate  contracts  with  providers 
(Bachman,  1996;  Essock  &  Goldman,  1995;  Frank,  McGuire  &  Newhouse,  1995). 
DMHAS  can  only  estimate  actual  costs  of  services  it  provides,  because  information 
systems  and  service  definitions  preclude  precise  identification  of  resources  used  in  any 
given  service.  Further,  state  operated  facilities  may  have  less  incentives  to  improve,  as 
they  do  not  keep  the  revenue  they  generate,  but  rather  collect  for  the  state  General  Fund. 
State  budgetary  allowances  to  these  facilities  are  related  to  their  needs,  not  to  their 
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revenue.  DMHAS  may  have  lacked  the  necessary  information  and  structure  to 
implement  sophisticated  managed  care. 

Second,  due  to  the  extreme  poverty  and  stigma  that  many  clients  face,  providers 
become  one  of  the  strongest  interests  in  public  sector  behavioral  health  advocacy.  Their 
political  power  may  serve  to  undermine  some  managed  care  programs  effectiveness.  For 
example,  in  Arizona,  existing  county  run  clinics  were  given  special  preferences  in  their 
Medicaid  managed  care  program  (Paringer  &  McCall,  1991).  In  Iowa,  (Hoge,  Jacobs,  & 
Thakur,  1997)  the  mental  health  authority  forced  its  managed  care  contractor  to  use  an 
open  provider  panel. 

Third,  the  staff  implementing  the  GAP  are  state  employees,  and  they  may  be  less 
responsive  to  the  pressures  of  managed  care  models  than  the  private  employees  that 
implemented  most  of  the  managed  care  programs  discussed  above.  Union  and  civil 
service  protections  for  government  employees  ensure  that  their  job  security  is  not  as 
sensitive  to  their  individual  performance  as  their  private  sector  counterparts  (Essock  & 
Goldman,  1995).  With  reduced  financial  incentives  and  reduced  job  threat  due  to  poor 
performance,  professional  norms  that  encourage  patient  advocacy  may  be  stronger  for 
state  employees  than  for  privatized  staff.  This  issue  may  be  moot,  however,  because 
managed  care  incentives  may  not  work  against  professional  norms  that  were  established 
in  a  public  sector  system  with  a  tradition  of  prepayment  (Buckler,  1996;  Boyle  & 
Callahan,  1995;  Daniels,  1985). 

Despite  these  speculative  concerns  to  the  contrary.  DMHAS  may  have  felt  the 
GAP  model  was  most  expedient,  for  two  reasons.  First,  DMHAS  had  already 
implemented  a  prior  authorization  model  for  state  inpatient  hospitals  with  some  success, 
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capitation  are  (Hoge,  Davidson,  Griffith,  Sledge,  &  Howenstine,  1994;  Sledge, 
Astrachan,  Thompson,  Rakfeldt  &  Leaf,  1995).  In  fact,  I  would  argue  that  many  clinical 
staff  at  DMHAS  view  the  case  managers  as  advocates  of  their  clients,  and  not  a  payer's 
agent  to  lower  cost  or  control  utilization.  For  this  reason,  the  following  discussion  of 
managed  care  will  focus  only  on  utilization  management  and  prepayment  in  the  public 
sector. 

The  GAP  receives  an  annual  budget  based  on  projected  utilization,  and  pays 
private  providers  on  a  fee-for-service  basis  using  a  Medicaid  fee  schedule.  This  global 
funding  is  similar  to  the  pure  capitation  model,  under  which  providers  receive  a  fixed 
sum  per  time  unit  per  client,  and  are  expected  to  meet  all  of  their  clients  health  needs  with 
that  total  sum.  In  a  classic  capitation  program,  providers  are  at  financial  risk  for  cost 
overruns,  but  also  keep  any  surplus. 

1)  Financing  methods 

a)  Traditional  methods 

Prepayment  may  reduce  expenses  and  improve  service  coordination  by 

centralizing  financing  of  care  (e.g.  Deiker,  1986,  Reed,  Hennessy  &  Babigian,  1995, 

Yank,  Hargrove  &  Davis,  1995).  A  form  of  prepayment,  capitation,  is  increasingly  being 

adopted  by  state  governments  to  manage  the  health  benefits  they  pay  for.  However,  both 

capitation  and  global  funding  heighten  principle-agent  conflicts  because  providers 

understand  the  value  of  delivered  services  better  than  the  payer,  and  the  providers  have 

incentives  to  under-treat  (Essock  &  Goldman,  1995;  Frank  &  Gaynor,  1994;  McGuire  & 

Riordan,  1993). 
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that  some  emergency  departments  are  starting  to  send  clients  to  the  GAP  directly,  instead 
of  attempting  to  admit  them  into  inpatient  behavioral  health  services. 

During  this  GAP  assessment,  the  client  is  assessed  for  mental  health,  substance 
abuse  and  vocational  needs.  An  entitlement  application  is  also  started  at  this  point.  After 
assessment,  clients  can  be  referred  to  pre-vocational  treatment,  job  club,  job  search,  or 
brief  treatment.  Referrals  for  substance  abuse  detoxification,  if  needed,  are  made 
immediately. 

The  Bridgeport  Brief  Treatment  Unit  is  specifically  designed  to  help  engage  and 
retain  GA  clients  in  behavioral  health  services,  and  its  mixture  of  group  and  individual 
therapy  allow  GAP  staff  to  form  relationships  with  clients  and  monitor  their  progress. 
This  interaction  is  seemingly  the  most  intense  of  the  three  GAP  sites.  Clients  that  attend 
support  and  education  groups  run  by  the  Brief  Treatment  Unit  while  they  are  on 
substance  abuse  rehabilitation  wait  lists.  If  the  client  has  a  serious  mental  illness,  they 
are  referred  to  the  LMHA,  and  the  GAP  tracks  their  utilization  and  provider  prior 
authorizations  for  non-LMHA  services.  The  Hispanic  unit  offers  all  of  these  services  as 
well  as  intake  for  monolingual  clients. 

2)  Bridgeport  uses  a  gatekeeper  model 

Bridgeport  relies  on  a  prior  authorization  model  like  the  other  sites.  However, 

any  GAP  caseworker  can  authorize  any  type  of  service  and  amount  of  that  service. 
During  off  hours,  hospitals  will  page  senior  staff  to  approve  care.  The  GAP  does  not 
often  refuse  hospital  requests.  Emergency  departments  are  starting  to  send  clients 
directly  to  the  GAP  office  during  business  hours  and  the  Hispanic  unit  has  been  know  to 
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divert  hospitalizations  to  less  intensive  settings  (these  should  probably  viewed  not  as 
refusals  of  hospital  requests  but  as  better  crisis  management). 

Bridgeport  also  has  a  very  loose  provider  network.  They  have  formal  contracts 
with  some  providers,  usually  to  negotiate  discounts  or  privileges  (such  as  reserved  or 
priority  beds).  They  have  a  strong  informal  network  to  which  they  also  refer  clients, 
consisting  of  any  provider  who  will  treat  GA  clients  well.  There  is  a  formal  appeals 
process  for  utilization  management  decisions,  but  as  of  1996m,  it  has  never  been  used. 

The  following  flow  chart  summarizes  key  Bridgeport  GAP  characteristics. 
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A.  Bridgeport 

The  Bridgeport  GAP  is  a  division  of  the  Bridgeport  LMHA  and  receives  about 
$2.5  million  a  year  in  funding.  It  has  no  permanent  office  space  in  the  LMHA  proper. 
Initially,  the  entire  GAP  staff  (about  20)  were  located  at  the  GA  city  offices.  In  1995, 
most  (all  but  6)  moved  to  an  LMHA  satellite  office  downtown,  a  few  blocks  from  the 
welfare  building,  leaving  only  a  few  staff  at  the  welfare  office  for  screenings. 

1)  Bridgeport  Intake 

Clients  enter  GA  through  a  45  to  60  minute  intake  interview  provided  by  a  City 

caseworker,  who  remains  that  client's  primary  GA  case  worker  for  at  least  that  episode 
(Bridgeport  GA  caseworkers  typically  have  caseloads  ranging  from  125-165  clients  each, 
and  generally  have  high  school  to  college  level  training).  GA  Caseworkers  have 
received  some  training  from  the  GAP  on  how  to  identify  clients  who  may  be  in  need  of 
behavioral  health  services.  Clients  who  appear  intoxicated,  in  withdrawal,  or  exhibit 
unusual  behavior  may  be  referred  to  the  GAP.  These  referred  client  are  then  escorted 
down  the  hall  to  the  GAP  intake  unit  for  assessment.  Monolingual  clients  are  assessed  by 
the  Hispanic  unit  at  the  satellite  office.  There  is  almost  no  wait  for  this  referral,  and  GAP 
staff  estimate  that  only  about  10%  of  clients  referred  to  them  have  no  real  service  needs. 

Like  other  GAP  sites,  the  primary  intake  source  is  the  city  welfare  office.  Clients 
may  also  enter  the  GAP  system  via  the  Bridgeport  LMHA,  who  refers  all  cases  with  GA 
benefits  to  the  GAP  for  case  management.  Clients  with  GA  benefits  requesting  substance 
abuse  or  mental  health  services  from  area  providers  are  also  referred  to  the  GAP  by  the 
providers  themselves,  or  in  the  cases  of  emergency  departments,  by  the  LMHA  mobile 
crisis  unit.  As  the  reputation  of  the  program  has  spread,  Bridgeport  staff  have  reported 


69 


Table  4-3:  New  Haven  GAP  Policy  Periods 


Period 

Start 

Stop 

Length 

Event 

Period  1 

08/31/92 

06/30/93 

304 

Baseline 

Period  2 

07/01/93 

01/31/94 

215 

Beginning  of  GAP  funding 

Period  3 

02/01/94 

01/31/95 

365 

GAP  claims  to  be  fully  operational,  and  sends 

assessment  staff  to  the  GA  'triage  gate' 

Period  4 

02/01/95 

06/30/95 

150 

Staff  at  full  complement 

Period  5 

07/01/95 

03/31/96 

275 

Department  of  Mental  Health  and  Division 

Addiction  Services  merge  into  DMHAS 

Period  6 

04/01/96 

08/31/96 

153 

No  special  events 

Total 

08/31/92 

08/31/96 

1462 

Table  4-4:  Hartford  GAP  Policy  Periods 

Period 

Start 

Stop 

Length 

Event 

Period  1 

04/01/92 

06/30/93 

456  ■ 

Baseline 

Period  2 

07/01/93 

11/30/93 

153  • 

Beginning  of  GAP  funding 

Period  3 

12/01/93 

04/30/95 

516  ■ 

GAP  claims  to  be  fully  operational 

Period  4 

05/01/95 

09/30/95 

153  ■ 

Staff  Begins  Utilization  management  for  LMHA 

services 

Period  5 

10/01/95 

01/31/96 

123  ■ 

Some  GA  clients  assessed  before  GA  Caseworker 

referral 

Period  6 

02/01/96 

08/31/96 

213 

Some  staff  reassigned  to  other  units 

Total 

04/01/92 

08/31/96 

1614 

Attempting  to  attribute  change  in  client  level  outcome  to  changes  in 


organizational  policy  will  be  difficult — polices  are  generally  far  too  incremental  and 
weak  to  translate  into  client  results.  However,  since  the  ultimate  goal  of  each  policy  is  to 
change  a  clients'  experience  with  the  behavioral  health  system,  judging  a  policy's 
effectiveness  by  client  level  measures  is  a  fair  standard. 

3)  Covariates  of  Interest 

In  addition  to  the  six  policy  periods,  the  five  levels  of  access  a  GA  client  could 

receive  could  be  influenced  by  other  factors.  These  variables  will  be  briefly  described 

here.  More  detail  on  them  will  presented  in  Chapter  6. 
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These  graphs  show  an  increase  in  access  to  DMHAS  care  soon  after 
implementation  of  the  GAP.  This  increase  is  most  pronounced  among  clients  receiving 
care  when  their  GA  medical  benefits  are  active.  There  are  some  minor  changes  in  crude 
access  rates  that  seem  to  coincide  with  changes  in  policies  after  the  GAP  was 
implemented.  Most  notable  is  the  spike  in  rates  in  Hartford,  that  occurred  when  the  GAP 
staff  bypassed  the  traditional  GA  caseworker  referral  mechanism.  Other  programmatic 
intra-site  variation  may  become  apparent  with  more  sophisticated  modeling  techniques. 
Clearly  it  will  be  useful  to  preserve  as  much  operational  detail  as  possible  in  any  future 
statistical  analysis. 

I  considered  a  variety  of  repeated  multivariate  methods  to  explore  this 
relationship  further,  with  two  constraints:  First,  since  each  GAP  site  worked  in  different 
ways,  it  seemed  most  prudent  to  model  each  site  separately.  Second,  given  the  large 
number  of  unduplicated  client  counts  in  each  data  set,  the  overall  number  of  time  units 
analyzed  would  have  to  be  dramatically  decreased.  (For  example,  the  Hartford  data  in 
Figure  4-1  summarizes  52  months*  24,849  subjects*3  levels  of  outcome,  for  a  full  matrix 
containing  3,876,444  elements.)  However,  there  does  appear  to  be  variation  occurring 
over  time  that  is  contemporaneous  with  different  changes  within  each  GAP  site.  Not 
wanting  to  lose  this  detail,  I  chose  the  six  most  significant  events  by  which  to  divide  the 
period  of  program  implementation.  These  policy  periods,  start  and  stop  days,  length  in 
days,  and  brief  description  of  the  most  salient  events  of  each  period  are  displayed  in 
Table  4-3  and  Table  4-4. 
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